Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on May 9, 2025

• Add vision evals (#133)

  Show description for 846c2cc
  

  michaelharrisonmai

  and

  Michael Harrison

  authored
  846c2cc

  Copy full SHA for 846c2cc

Commits on May 8, 2025

• Vibhav/tsp1 (#136)

  Show description for 08c8343
  vibhav-vineet

  authored
  08c8343

  Copy full SHA for 08c8343

Commits on Apr 17, 2025

• GSM8K benchmark integration (#99)

  Show description for 5e1b30c
  risaueno

  authored
  5e1b30c

  Copy full SHA for 5e1b30c

Commits on Apr 16, 2025

• Added parameter to take first or last answer (#130)

  Show description for 9be0dee
  

  neelsj

  and

  neel

  authored
  9be0dee

  Copy full SHA for 9be0dee

Commits on Apr 10, 2025

• minor fixes (#117)

  Show description for d373a38
  

  michaelharrisonmai

  and

  Michael Harrison

  authored
  d373a38

  Copy full SHA for d373a38

Commits on Apr 9, 2025

• Jsonlines (#127)

  Show description for fbef92b
  

  safooray

  and

  Safoora Yousefi

  authored
  fbef92b

  Copy full SHA for fbef92b

• Bump estree-util-value-to-estree from 3.1.2 to 3.3.3 in /website (#124)

  Show description for 1ff98df
  dependabot[bot]

  authored
  1ff98df

  Copy full SHA for 1ff98df

• Bump image-size from 1.1.1 to 1.2.1 in /website (#119)

  Show description for a199e7e
  dependabot[bot]

  authored
  a199e7e

  Copy full SHA for a199e7e

• Benushi/seed bugfix (#126)

  Show description for 934cb83
  

  nushib

  and

  Besmira Nushi

  authored
  934cb83

  Copy full SHA for 934cb83

Commits on Apr 8, 2025

• vllm version upgrade (#125)

  Show description for d664359
  

  safooray

  and

  Safoora Yousefi

  authored
  d664359

  Copy full SHA for d664359

Commits on Apr 7, 2025

• Phi sys (#123)

  Show description for ed2c958
  

  safooray

  and

  Safoora Yousefi

  authored
  ed2c958

  Copy full SHA for ed2c958

Commits on Apr 5, 2025

• Phi sys (#122)

  Show description for fd6361f
  

  safooray

  and

  Safoora Yousefi

  authored
  fd6361f

  Copy full SHA for fd6361f

Commits on Apr 4, 2025

• Configs for bigger maze dataset and COT vs non COT prompt options (#115)

  Show description for 519225c
  

  neelsj

  and

  neel

  authored
  519225c

  Copy full SHA for 519225c

• Vllm hotfix (#121)

  Show description for 8868926
  

  safooray

  and

  Safoora Yousefi

  authored
  8868926

  Copy full SHA for 8868926

• Option to pass extra body to openai (#112)

  Show description for caa942f
  

  vidhishanair

  and

  Vidhisha Balachandran

  authored
  caa942f

  Copy full SHA for caa942f

Commits on Mar 26, 2025

• Report aggregation change for gpqa, Claude 3.7 config update (#114)

  Show description for 9d5664c
  

  nushib

  and

  Besmira Nushi

  authored
  9d5664c

  Copy full SHA for 9d5664c

Commits on Mar 17, 2025

• Remove inference batching (#111)

  Show description for 04cc86c
  

  3 peopleauthored
  04cc86c

  Copy full SHA for 04cc86c

• LocalVLLMModel and deployment handler (#102)

  Show description for bd1a02b
  

  3 peopleauthored
  bd1a02b

  Copy full SHA for bd1a02b

Commits on Mar 16, 2025

• validate usage columns for extract usage (#110)

  Show description for 45e802e
  

  vidhishanair

  and

  Vidhisha Balachandran

  authored
  45e802e

  Copy full SHA for 45e802e

Commits on Mar 15, 2025

• Addressing concurrency issues (#105)

  Show description for 9bfdcd3
  

  safooray

  and

  Safoora Yousefi

  authored
  9bfdcd3

  Copy full SHA for 9bfdcd3

Commits on Mar 13, 2025

• Vidhisha/ba benchmarks (#88)

  Show description for 148cc01
  

  vidhishanair

  and

  Vidhisha Balachandran

  authored
  148cc01

  Copy full SHA for 148cc01

• Add support for claude thinking models (#103)

  Show description for 23e1a87
  Holmeswww

  authored
  23e1a87

  Copy full SHA for 23e1a87

Commits on Mar 12, 2025

• Bump @babel/runtime-corejs3 from 7.25.6 to 7.26.10 in /website (#107)

  Show description for ede9ee1
  dependabot[bot]

  authored
  ede9ee1

  Copy full SHA for ede9ee1

• Bump @babel/helpers from 7.25.6 to 7.26.10 in /website (#108)

  Show description for 1751de0
  dependabot[bot]

  authored
  1751de0

  Copy full SHA for 1751de0

• Bump @babel/runtime from 7.25.6 to 7.26.10 in /website (#109)

  Show description for f7afc31
  dependabot[bot]

  authored
  f7afc31

  Copy full SHA for f7afc31

• Bump prismjs from 1.29.0 to 1.30.0 in /website (#104)

  Show description for 312c7dc
  dependabot[bot]

  authored
  312c7dc

  Copy full SHA for 312c7dc

• Benushi/serverless r1 azure (#106)

  Show description for f3b8e58
  

  nushib

  and

  Besmira Nushi

  authored
  f3b8e58

  Copy full SHA for f3b8e58

Commits on Mar 7, 2025

• use vllm's template conversion (#98)

  Show description for a49c525
  

  3 peopleauthored
  a49c525

  Copy full SHA for a49c525

Commits on Mar 5, 2025

• Changes to support o3 - reasoning_effort param

  Show description for 2e51b4f
  

  vidhishanair

  and

  Vidhisha Balachandran

  authored
  2e51b4f

  Copy full SHA for 2e51b4f

Commits on Mar 4, 2025

• configuring the openai base url (#100)

  Show description for d6bb418
  

  vidhishanair

  and

  Vidhisha Balachandran

  authored
  d6bb418

  Copy full SHA for d6bb418

Commits on Mar 1, 2025

• Gpqa security (#101)

  Show description for 7a9913d
  

  safooray

  and

  Safoora Yousefi

  authored
  7a9913d

  Copy full SHA for 7a9913d

Commits on Feb 24, 2025

• Gpqa experiment pipeline updates (#84)

  Show description for 8beddf5
  

  nushib

  and

  Besmira Nushi

  authored
  8beddf5

  Copy full SHA for 8beddf5

Commits on Feb 13, 2025

• Adds support for vLLM-based models. (#93)

  Show description for 2d28ffe
  

  gugarosa

  and

  safooray

  authored
  2d28ffe

  Copy full SHA for 2d28ffe

Commits on Feb 11, 2025

• adding together ai models (#95)

  Show description for 0c50b96
  

  nushib

  and

  Besmira Nushi

  authored
  0c50b96

  Copy full SHA for 0c50b96

Commits on Feb 7, 2025

• adding new configs for open ai, gemini, claude, and phi hf (#94)

  Show description for 749f644
  

  nushib

  and

  Besmira Nushi

  authored
  749f644

  Copy full SHA for 749f644

Pagination

Previous

Next