Skip to content

Release Notes for Split_LoRA v1.1.0

Choose a tag to compare

View all tags
@shiyizhiyang shiyizhiyang released this 09 Jan 10:21
· 40 commits to main since this release
v1.1.0
69d0232
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

[1.1.0] 2025-01-09

We are excited to announce the release of version 1.1.0 of the Split-LoRA project! This update brings a host of new features, including the highly anticipated support for Llama3 training and inference, along with various performance improvements and bug fixes to enhance your experience.

New Features

  • Llama3.1 Support: his release introduces the capability to train the Llama3 model using our split learning framework, optimizing computational load and reducing communication overhead.
  • LoRA Integration: Incorporates low-rank adaptive methods, drastically reducing model parameter count, and making models more lightweight and suitable for resource-constrained environments.

Contribution

We welcome contributions and feedback from the community. If you have any questions or suggestions, please submit them via GitHub Issues or contribute directly to our repository.
Thank you once again for your support and participation!

Assets 4
Loading