Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The third example problem is incorrect #4

Open
melaniebeck opened this issue Nov 14, 2022 · 1 comment
Open

The third example problem is incorrect #4

melaniebeck opened this issue Nov 14, 2022 · 1 comment

Comments

@melaniebeck
Copy link

image

"With one person drinking 5, that brings the total drank to 5+9+8+3=25" is incorrect according to the problem setup and should instead be 5+9+8=22.

The accompanying paper estimates that fewer than 2% of problems have errors like the one above. Unless this example was explicitly cherry-picked to demonstrate an incorrect problem, it is either exceedingly unlucky that this problem made it into the showcased examples or the frequency of incorrect examples is likely higher.

@zsc
Copy link

zsc commented Apr 30, 2023

Thanks for pointing out! Fortunately, they got it correct in the train.jsonl anyway.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants