Skip to content

Pull requests: huggingface/lighteval

New pull request New
14 Open 132 Closed
14 Open 132 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Removes default bert scorer init short_to_review
#234 opened Jul 18, 2024 by clefourrier Loading…
Fixes #165 - adds a check with generation length is not set by the user short_to_review
#233 opened Jul 18, 2024 by clefourrier Loading…
Fixing issues with multichoice_continuations_start_space - was not parsed properly
#232 opened Jul 18, 2024 by clefourrier Loading…
1
Remove the latex writer since we don't use it short_to_review
#231 opened Jul 17, 2024 by clefourrier Loading…
1
Expose samples via the CLI
#228 opened Jul 17, 2024 by clefourrier Loading…
1
1
Adding OZ Eval task
#225 opened Jul 15, 2024 by Stopwolf Loading…
adds llm as judge using transformers
#223 opened Jul 11, 2024 by NathanHB • Draft
Fixing PIQA implementation short_to_review
#222 opened Jul 11, 2024 by clefourrier Loading…
1
Tiny improvements to endpoint_model.py, base_model.py,...
#219 opened Jul 8, 2024 by sadra-barikbin Loading…
2
A small improvement in metrics_sample.py::ROUGE
#217 opened Jul 7, 2024 by sadra-barikbin Loading…
4
Ar support for MBZUAI-arabic-mmlu
#209 opened Jul 3, 2024 by bakrianoo Loading…
14
Transformers model as Judge
#174 opened Apr 26, 2024 by anilaltuner Loading…
8
Nanotron tests
#160 opened Apr 19, 2024 by zzhhjjj Loading…
5
Add optimum model
#106 opened Mar 11, 2024 by echarlaix • Draft
ProTip! Mix and match filters to narrow down what you’re looking for.