Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Can you transform the v0 checkpoint to the compatible version of new branch? #52

Closed
lovecambi opened this issue May 21, 2023 · 2 comments
Closed

Can you transform the v0 checkpoint to the compatible version of new branch? #52

lovecambi opened this issue May 21, 2023 · 2 comments

Comments

@lovecambi
Copy link

I've used the v0 checkpoint for some experiments.
@LukeForeverYoung
Copy link
Collaborator

If you want to use the v0 checkpoint, you could switch to the v0 branch. The latest model has fixed several issues and removed some dependencies that were difficult to install (such as FusedLayerNorm in Apex), making it incompatible with the v0 checkpoint. Converting the v0 checkpoint to fit the current model may result in precision issues.

@MAGAer13
Copy link
Collaborator

MAGAer13 commented May 21, 2023 •
edited

Besides, for the latest version we follow the same recipe and no more extra data is used. Sorry for your inconvenience.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@lovecambi @LukeForeverYoung @MAGAer13