Skip to content

345M model support

Choose a tag to compare

View all tags
@minimaxir minimaxir released this 05 May 05:39
· 104 commits to master since this release
v0.4
583fdb0
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
  • Support the 345M model (thanks to Neil Shepperd for the gradient checkpointing implementation!)
  • Support model_name in the CLI for above support
  • Support run_name in the CLI
  • Support .csv files as an input dataset to finetune (will parse the CSV as if it was done via encode_csv()).
  • Fix one off issues (#21)
Assets 3
Loading