v1.5.1

English version

New Features

1. Support dtype settings in LoRA
2. Support deactivated tuners offloading
3. Support deployment with OpenAI format restful API
4. Make LongLoRA supports the latest llama2 code

新feature

1. 支持LoRA设置dtype类型
2. 支持将不使用的tuners offloading到cpu和meta设备上
3. 支持OpenAI restful API方式的部署
4. LongLoRA支持最新的llama2代码

What's Changed

• update docs by @tastelikefeet in #269
• Update benchmark 0101 by @Jintao-Huang in #271
• update benchmark by @Jintao-Huang in #276
• Support dtype in lora by @tastelikefeet in #278
• Support deploy by @Jintao-Huang in #275
• update deploy client by @Jintao-Huang in #279
• Support offload by @tastelikefeet in #281
• fix tuner bug by @Jintao-Huang in #285
• Support lora_modules_to_save by @Jintao-Huang in #284
• update template by @Jintao-Huang in #286
• support ModuleToSave original module offloading by @tastelikefeet in #282
• Fix offload by @tastelikefeet in #288
• fix scedit bug by @tastelikefeet in #290
• fix bnb qwen bug by @Jintao-Huang in #289
• update readme by @Jintao-Huang in #291
• update readme by @Jintao-Huang in #292
• Fix/longlora by @tastelikefeet in #294
• support additional_trainable_parameters by @Jintao-Huang in #295
• fix webui by @tastelikefeet in #296
• fix trainer push to hub by @Jintao-Huang in #297

Full Changelog: v1.5.0...v1.5.1