Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about the checkpoint provided in this repo #28

Open
StarDewXXX opened this issue Mar 20, 2024 · 3 comments
Open

Question about the checkpoint provided in this repo #28

StarDewXXX opened this issue Mar 20, 2024 · 3 comments

Comments

@StarDewXXX
Copy link

Is the checkpoint provided in this repo trained with the old version of zephyr-7b-sft-full?

@StarDewXXX
Copy link
Author

if I want to reproduce the results reported in SPIN's paper, should I use revision=ac6e600eefcce74f5e8bae1035d4f66019e93190 and train with the SPIN dataset(iter 0,1,2,3) provided in huggingface?

@angelahzyuan
Copy link
Collaborator

Yes, and we have updated the scripts and guidelines to reproduce the results in our paper. We specified the version by adding model_revision parameter in config.yaml. Please check our recent update and let us know if there are any remaining questions.

@angelahzyuan
Copy link
Collaborator

if I want to reproduce the results reported in SPIN's paper, should I use revision=ac6e600eefcce74f5e8bae1035d4f66019e93190 and train with the SPIN dataset(iter 0,1,2,3) provided in huggingface?

https://github.com/uclaml/SPIN/blob/main/configs/config.yaml

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants