Files

 main

/

chat_benchmarks

/

Copy path

Directory actions

More options

Directory actions

More options

Latest commit

jmercat

OpenAI API key handling and task loading in evaluation framework (#88)

Mar 16, 2025

c8ae981 · Mar 16, 2025

History

History

/

chat_benchmarks

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
AIME24		AIME24	Add the ability to do inference externally to Evalchemy (#91)	Mar 12, 2025
AIME25		AIME25	Add the ability to do inference externally to Evalchemy (#91)	Mar 12, 2025
AIW		AIW	aiw	Feb 23, 2025
AMC23		AMC23	Add the ability to do inference externally to Evalchemy (#91)	Mar 12, 2025
BigCodeBench		BigCodeBench	fix broken imports	Jan 20, 2025
CruxEval		CruxEval	lint	Jan 22, 2025
GPQADiamond		GPQADiamond	fixed bug in gpqa (shuffled answer choices)	Mar 14, 2025
HumanEval		HumanEval	fix broken import	Jan 27, 2025
HumanEvalPlus		HumanEvalPlus	fix broken import	Jan 27, 2025
IFEval		IFEval	unify generate kwargs	Jan 9, 2025
LiveBench		LiveBench	Fix CodeBench judgement error	Feb 24, 2025
LiveCodeBench		LiveCodeBench	Add the ability to do inference externally to Evalchemy (#91)	Mar 12, 2025
MATH500		MATH500	Add the ability to do inference externally to Evalchemy (#91)	Mar 12, 2025
MBPP		MBPP	Initial commit	Nov 18, 2024
MBPPPlus		MBPPPlus	Update eval_instruct.py	Jan 29, 2025
MTBench		MTBench	OpenAI API key handling and task loading in evaluation framework (#88)	Mar 16, 2025
MixEval		MixEval	OpenAI API key handling and task loading in evaluation framework (#88)	Mar 16, 2025
MultiPLE		MultiPLE	update readme	Jan 21, 2025
RepoBench		RepoBench	Initial commit	Nov 18, 2024
SWEbench		SWEbench	linting and some fixes	Feb 6, 2025
WildBench		WildBench	OpenAI API key handling and task loading in evaluation framework (#88)	Mar 16, 2025
alpaca_eval		alpaca_eval	OpenAI API key handling and task loading in evaluation framework (#88)	Mar 16, 2025
zeroeval		zeroeval	OpenAI API key handling and task loading in evaluation framework (#88)	Mar 16, 2025
__init__.py		__init__.py	Initial commit	Nov 18, 2024
curator_lm.py		curator_lm.py	add model args in currator to have a similar interface as other lm_ev…	Feb 6, 2025
precomputed_hf_lm.py		precomputed_hf_lm.py	Add the ability to do inference externally to Evalchemy (#91)	Mar 12, 2025
upload_to_hf_lm.py		upload_to_hf_lm.py	Add the ability to do inference externally to Evalchemy (#91)	Mar 12, 2025
View all files