Skip to content

Pull requests: stanford-crfm/helm

New pull request New
16 Open 1,736 Closed
16 Open 1,736 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add output_format_instructions run expander for MATH
#2789 opened Jul 3, 2024 by yifanmai Loading…
BHASA syntax prototyping
#2778 opened Jun 27, 2024 by yifanmai • Draft
Add local tokenizer for AI21
#2775 opened Jun 26, 2024 by yifanmai Loading…
1
Fix bugs in compute_request_limits.py
#2708 opened Jun 3, 2024 by yifanmai Loading…
[Issues #2439] Refactor the validation out of clients and add it to the request.py
#2686 opened May 29, 2024 by SathvikNapa Loading…
3
Add ModelAsJudgeAnnotator
#2679 opened May 24, 2024 by farzaank Loading…
5
Delete CohereWindowService
#2669 opened May 22, 2024 by yifanmai Loading…
Deprecate many OpenAI, AI21 and Cohere models
#2668 opened May 22, 2024 by yifanmai Loading…
fix R/B channel switch in skin tone calculation
#2589 opened Apr 24, 2024 by rbitr Loading…
2
Initial contact center base scenario setup and added summarization scenario
#2569 opened Apr 12, 2024 by chuanw24 Loading…
5
Documentation: Evaluation run lifecycle
#2506 opened Mar 25, 2024 by yifanmai Loading…
11
Documentation: Custom models
#2463 opened Mar 14, 2024 by yifanmai Loading…
8
Remove AdapterSpec from metrics
#2244 opened Jan 17, 2024 by yifanmai • Draft
9
Numeracy scenario update
#1978 opened Nov 2, 2023 by friedeggs Loading…
1
Update developer docs for running locally and committing code.
#1965 opened Oct 27, 2023 by brianwgoldman Loading…
Update documentation for how to add scenarios and metrics.
#1933 opened Oct 23, 2023 by brianwgoldman Loading…
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.