Skip to content

EasyDeL - 0.0.67
Compare
Choose a tag to compare
@erfanzar erfanzar released this 02 Jun 14:24
· 206 commits to main since this release
0.0.66
d33d2e8
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

  • New Features

    • GenerationPipeLine was added for fast streaming and easy generation with JAX.
    • Using Int8Params instead of LinearBitKernel.
    • Better GPU support.
    • EasyDeLState is now better and supports more general options.
    • Trainers now support .save_pretrained(to_torch) and training logging.
    • EasyDeLState supports to_8bit.
    • All of the models support to_8bit for params.
    • imports are now 91x times faster in EasyDeL version 0.0.67.

  • Removed API

    • JAXServe is no longer available.
    • PyTorchServe is no longer available.
    • EasyServe is no longer available.
    • LinearBitKernel is no longer available.
    • EasyDeL partitioners are no longer available.
    • Llama/Mistral/Falcon/Mpt static convertors or transforms are no longer available.

  • Known Issues

    • Lora Kernel Sometimes Crash.
    • GenerationPipeLine has a compiling problem when the number of available devices is more than 4 and using 8_bit params.
    • Most of the features won't work for TPU-v3 and GPUs with compute capability lower than 7.5.
    • Kaggle session will crash after importing EasyDeL (Kaggle's latest environment is not stable it's not related to EasyDeL). (Fixed in EasyDeL version 0.0.67)
Assets 2
Loading
0 Join discussion