Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Various minor fixes for training pythia-6b #2003

Merged
merged 4 commits into from Mar 7, 2023
Merged

Conversation

dvruette
Copy link
Collaborator

@dvruette dvruette commented Mar 7, 2023

Namely:

  • Fix the random seed for dataset splitting
  • Save the model after training (final checkpoint)
  • Add config option to enable/disable custom sampler
  • Update config values

@dvruette dvruette enabled auto-merge March 7, 2023 09:14
@sanagno sanagno mentioned this pull request Mar 7, 2023
@sanagno sanagno enabled auto-merge (squash) March 7, 2023 09:15
@sanagno sanagno merged commit e51c517 into main Mar 7, 2023
1 check passed
@sanagno sanagno deleted the pythia-6b-training-fixes branch March 7, 2023 09:16
alando46 pushed a commit to alando46/Open-Assistant that referenced this pull request Mar 10, 2023
Namely:
- Fix the random seed for dataset splitting
- Save the model after training (final checkpoint)
- Add config option to enable/disable custom sampler
- Update config values
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants