Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Potential typos in CoT prompts #4

Closed
samar-khanna opened this issue Mar 8, 2023 · 3 comments
Closed

Potential typos in CoT prompts #4

samar-khanna opened this issue Mar 8, 2023 · 3 comments

Comments

@samar-khanna
Copy link

samar-khanna commented Mar 8, 2023

Thank you for your very interesting paper and for sharing the code base! I think there might be a few typos in the cot-prompts that might be worth investigating:

On line 11 of multistep_arithmetic_two.txt, should this line:

Then, the final equation is A * B = -41 * -3 = (-61) * (-3) = 123. So the answer is 123.

instead be

Then, the final equation is A * B = -41 * -3 = (-41) * (-3) = 123. So the answer is 123.
@samar-khanna samar-khanna changed the title Typo in CoT prompt for multi-step arithmetic Typo in CoT prompt for multi-step arithmetic and navigate Mar 9, 2023
@samar-khanna
Copy link
Author

samar-khanna commented Mar 9, 2023

A possible typo on line 44 of navigate.txt

(4) Take 7 steps right: (0, 7), facing the positive y-axis.

should be

(4) Take 7 steps right: (0, 0), facing the positive y-axis.

@samar-khanna samar-khanna changed the title Typo in CoT prompt for multi-step arithmetic and navigate Typos in CoT prompts Mar 9, 2023
@samar-khanna
Copy link
Author

samar-khanna commented Mar 9, 2023

An typo on line 9 of web_of_lies.txt

(3) Vina says Jerry tells the truth. Since we know from (2) that Jerry tells the truth, if Vine says Jerry tells the truth, then Vina tells the truth.

should be

(3) Vina says Jerry tells the truth. Since we know from (2) that Jerry tells the truth, if Vina says Jerry tells the truth, then Vina tells the truth.

@samar-khanna samar-khanna changed the title Typos in CoT prompts Potential typos in CoT prompts Mar 10, 2023
@suzgunmirac
Copy link
Owner

Hi @samar-khanna ,

Thank you so much for your meticulous examination of all our prompt files and for bringing to our attention these three minor typos. After reviewing your suggested corrections, I agree that they are all accurate. Thank you again for your help!

All the best,

MS.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants