Skip to content

Example Submission PR#5

Closed
curtischong wants to merge 1 commit intomainfrom
example-submission
Closed

Example Submission PR#5
curtischong wants to merge 1 commit intomainfrom
example-submission

Conversation

@curtischong
Copy link
Copy Markdown
Collaborator

@curtischong curtischong commented Apr 10, 2026

This is an example PR for how to submit to LitXBench.

The main idea is we want to provide sufficient credit (and proof) of your work! Thus, we need five things:

  1. We need a link to the code that generated the results.
  2. We need a link to the run with the generated output code. This is important because if the evaluation method for a LitXBench dataset changes, then we can rerun the evaluation on your extracted code to get the new results. (Obviously we'll require a completely new re-run if the ground-truth dataset changes).
  3. (optional) A link to your paper/blog to provider proper attribution for your work!
  4. A link to the PR that you submitted your contribution to. This is for future readers learn more about the method!
  5. (optional) A person of correspondence listed in this PR. This is for us to message if we release a big new version of a dataset. We'd send a brief message to ask if you'd like to submit to the new version!

That said, we would also appreciate some discussion about your new method in your PR so we can learn more about it and help promote it.

@curtischong curtischong changed the title Example Model Submission PR Example Submission PR Apr 10, 2026
@curtischong curtischong deleted the example-submission branch April 10, 2026 15:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant