Skip to content

leaderboard: method paper citations, dataset HuggingFace links, model icons - #40

Merged
radinhamidi merged 1 commit into
mainfrom
feat/leaderboard-method-citations-dataset-hf-model-icons
Jun 24, 2026
Merged

leaderboard: method paper citations, dataset HuggingFace links, model icons#40
radinhamidi merged 1 commit into
mainfrom
feat/leaderboard-method-citations-dataset-hf-model-icons

Conversation

@radinhamidi

Copy link
Copy Markdown
Member

Brings the leaderboard's method, dataset, and model surfaces up to parity with the marketing site and adds source links throughout.

Methods — paper citations

The home-page Method control is now a custom dropdown that lists a paper ↗ link per method, opening the paper in a new tab. Citations are sourced at build time from the curated method→paper map shared with the marketing site (web/site/src/data/methods.json), so there is a single source of truth. Variant ids (e.g. query2doc-cot/fs/zs) resolve to their base method's paper.

Datasets — HuggingFace links

Each dataset now carries a canonical HuggingFace subset link, surfaced on the /datasets cards, the /datasets/[id] header, and beside the dataset selector on the home page:

  • BEIR (6) → first-party BeIR/* repos
  • BRIGHT (12) → per-domain split in xlangai/BRIGHT (/viewer/examples/<domain>)
  • TREC-DL (3) → public passage mirrors

Two are approximations of the closest public HF home: TREC-NEWS links the BEIR generated-queries artifact (the WaPo corpus can't be redistributed), and DL19/DL20 link community passage mirrors (no first-party standalone repos exist).

Models — polished names + provider icons

Model ids render as polished display names (GPT-4.1, GPT-4.1 nano, Qwen2.5 72B Instruct, Qwen2.5 7B Instruct) with an OpenAI/Qwen logo icon in the home table LLM column and on the /models cards. Names flow from a single displayModel map.

Notes

  • HF URLs and model metadata are added in build-data.ts; provider logos live in src/lib/providerIcon.ts. Nothing is hardcoded in page templates.
  • Generated data shards under src/data/ stay gitignored (rebuilt at deploy).

🤖 Generated with Claude Code

… icons

- Method dropdown on the home page now lists a paper link per method,
  sourced from the curated method→paper map shared with the marketing site.
- Datasets carry HuggingFace subset links (BEIR, BRIGHT, TREC-DL), shown on
  the dataset cards, dataset detail headers, and beside the dataset selector.
- Models render polished display names (e.g. GPT-4.1, Qwen2.5 72B Instruct)
  with a provider logo icon in the home table LLM column and on model cards.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@radinhamidi
radinhamidi merged commit 6d2d192 into main Jun 24, 2026
2 checks passed
@radinhamidi
radinhamidi deleted the feat/leaderboard-method-citations-dataset-hf-model-icons branch June 24, 2026 01:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant