Skip to content

Second release

Choose a tag to compare

View all tags
@irenasaracay irenasaracay released this 28 Jun 13:34
· 37 commits to main since this release
2.0.0
5c90779

Major codebase updates, along with five new models.

Changes:

  • Add gradient checkpointing, FullyShardedDataParallel
  • Remove color jitter when training
  • Fix cross-attention bug when calling generate()
  • Model releases
    • (CLIP ViT-L-14 / MPT-1B)
    • (CLIP ViT-L-14 / MPT-1B Dolly)
    • (CLIP ViT-L-14 / RedPajama-3B)
    • (CLIP ViT-L-14 / RedPajama-3B Instruct)
    • (CLIP ViT-L-14 / MPT-7B)
Assets 2
Loading