Skip to content

v1.10.1

Choose a tag to compare

View all tags
@oobabooga oobabooga released this 13 Jul 17:56
v1.10.1
0315122
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Library updates

  • FlashAttention: bump to v2.6.1. Now Gemma-2 works in ExLlamaV2 with FlashAttention without any quality loss.

Bug fixes

  • Fix for MacOS users encountering model load errors with llama.cpp (#6227). Thanks @InvectorGator.

Contributors

InvectorGator
Assets 2
Loading