Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Support for Evaluation with HELM #370

Closed
wants to merge 4 commits into from
Closed

Add Support for Evaluation with HELM #370

wants to merge 4 commits into from

Conversation

jxtngx
Copy link
Member

@jxtngx jxtngx commented Aug 7, 2023 •
edited

This PR adds support for evaluation with HELM.

closes #349

  • determine how NeurIPS used helper.py::generate and implement
  • determine if a FastAPI server is required for local evaluation
  • create tests
  • familiarize with output of helm summarize

@jxtngx jxtngx linked an issue Aug 7, 2023 that may be closed by this pull request
Add Evaluation with HELM #349
Open
@jxtngx
Copy link
Member Author

jxtngx commented Aug 16, 2023

see #412

@jxtngx jxtngx closed this Aug 16, 2023
@carmocca carmocca deleted the justin/enh-helm-eval branch January 19, 2024 01:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@awaelchli awaelchli Awaiting requested review from awaelchli awaelchli will be requested when the pull request is marked ready for review awaelchli is a code owner

@carmocca carmocca Awaiting requested review from carmocca carmocca will be requested when the pull request is marked ready for review carmocca is a code owner

@lantiga lantiga Awaiting requested review from lantiga lantiga will be requested when the pull request is marked ready for review lantiga is a code owner

Assignees
No one assigned
Labels
evaluation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Add Evaluation with HELM
1 participant
@jxtngx