Skip to content

Conversation

@pan93412
Copy link
Contributor

Details 📑

  • Enable type checking for cli.oaieval
  • Correct the type in cli.oaieval

Final checklist 👀

Submission agreement

By contributing to Evals, you are agreeing to make your evaluation logic and data under the same MIT license as this repository. You must have adequate rights to upload any data used in an Eval. OpenAI reserves the right to use this data in future service improvements to our product. Contributions to OpenAI Evals will be subject to our usual Usage Policies (https://platform.openai.com/docs/usage-policies).

  • I agree that my submission will be made available under an MIT license and complies with OpenAI's usage policies.

Email address validation

If your submission is accepted, we will be granting GPT-4 access to a limited number of contributors. Access will be given to the email address associated with the merged pull request.

  • I acknowledge that GPT-4 access will only be granted, if applicable, to the email address used for my merged pull request.

Limited availability acknowledgement

We know that you might be excited to contribute to OpenAI's mission, help improve our models, and gain access to GPT-4. However, due to the requirements mentioned above and high volume of submissions, we will not be able to accept all submissions and thus not grant everyone who opens a PR GPT-4 access. We know this is disappointing, but we hope to set the right expectation before you open this PR.

  • I understand that opening a PR, even if it meets the requirements above, does not guarantee the PR will be merged nor GPT-4 access granted.

Submit eval

  • I have filled out all required fields of this form
  • (Ignore if not submitting code) I have run pip install pre-commit; pre-commit install and have verified that black, isort, and autoflake are running when I commit and push

@pan93412 pan93412 changed the title Squashed commit of the following: Add typing to cli.oaieval May 25, 2023
@pan93412 pan93412 force-pushed the type-cli-oaieval branch 3 times, most recently from 9a28076 to dffa348 Compare June 1, 2023 03:47
@pan93412 pan93412 force-pushed the type-cli-oaieval branch from dffa348 to c575e41 Compare June 2, 2023 16:06
jwang47
jwang47 previously approved these changes Jun 2, 2023
@jwang47 jwang47 merged commit cde88c0 into openai:main Jun 2, 2023
arbreton pushed a commit to arbreton/evals that referenced this pull request Jul 8, 2023
- Enable type checking for `cli.oaieval`
- Correct the type in cli.oaieval]
jacobbieker pushed a commit to withmartian/-ARCHIVED--router-evals that referenced this pull request Jan 9, 2024
- Enable type checking for `cli.oaieval`
- Correct the type in cli.oaieval]
Linmj-Judy pushed a commit to TablewareBox/evals that referenced this pull request Feb 27, 2024
- Enable type checking for `cli.oaieval`
- Correct the type in cli.oaieval]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants