Skip to content

Version 0.3.0 #364

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 114 commits into from
Sep 18, 2025
Merged

Version 0.3.0 #364

merged 114 commits into from
Sep 18, 2025

Conversation

@jlamypoirier
Copy link
Collaborator

@jlamypoirier jlamypoirier commented Sep 18, 2025 •
edited
Loading

✨ Description

Version to 0.3.0 and associated cleanup:

  • Explicitly prevent loading checkpoint from earlier version, with appropriate error message.
  • Rename training_dtype -> compute_dtype
  • Remove unused flat config format
  • Remove most backward compatibility code, as we no longer support previous versions anyway
  • Remove legacy dataset configuration. Add back a minimalistic version in test_match_megatron for testing purposes.
  • Remove concatenated memmap dataset.
  • Postpone or remove remaining todos for v0.3

@jlamypoirier
fixes
be69677
@jlamypoirier
Simplify bias options
82a70aa
@jlamypoirier
stuff
680980a
@jlamypoirier
Dynamic mlp and block layer creation
3ef7860
@jlamypoirier
stuff
ecad96b
@jlamypoirier
fix
3fd092c
@jlamypoirier
stuff
1a3497c
@jlamypoirier
stuff
b6e7fce
@jlamypoirier
stuff
4dfe2a4
@jlamypoirier
misc
4185741
@jlamypoirier
stuff
7763296
@jlamypoirier
fix
8249f8a
@jlamypoirier
Merge branch 'main' into concatenated_dim
188587e
@jlamypoirier
Merge branch 'concatenated_dim' into tp_mamba
e111509
@jlamypoirier
Merge branch 'tp_mamba' into block_interface
95e0231
@jlamypoirier
Merge remote-tracking branch 'origin/main' into block_interface
e076c7a
@jlamypoirier
Merge branch 'block_interface' into block_interface_weight
2315ac4
@jlamypoirier
Merge remote-tracking branch 'origin/main' into block_interface_weight
79356f7
@jlamypoirier
Merge branch 'block_interface_weight' into block_interface_mixer_mlp_…
e4198a6 
…config
@jlamypoirier
Merge branch 'block_interface_mixer_mlp_config' into block_interface_…
7abf263 
…fine_grained
@jlamypoirier
Merge branch 'block_interface_fine_grained' into block_interface_tflops
bfc9f84
@jlamypoirier
Merge branch 'block_interface_tflops' into block_interface_convert
e68f96c
@jlamypoirier
v0.3.0
870afd3
@jlamypoirier jlamypoirier marked this pull request as ready for review September 18, 2025 21:09
Base automatically changed from block_interface_convert to main September 18, 2025 21:17
tscholak
tscholak approved these changes Sep 18, 2025
View reviewed changes
Copy link
Collaborator

@tscholak tscholak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As discussed, LGTM!

@jlamypoirier jlamypoirier merged commit ca3b000 into main Sep 18, 2025
2 checks passed
@jlamypoirier jlamypoirier deleted the v0.3.0 branch September 18, 2025 21:43
@jlamypoirier jlamypoirier mentioned this pull request Sep 18, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tscholak tscholak tscholak approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@jlamypoirier @tscholak