partial implementation of lqlora

[Liebele]

PR types

PR changes

Description

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 0% with 41 lines in your changes are missing coverage. Please review.

Project coverage is 55.23%. Comparing base (277f45b) to head (33e2fbd).
Report is 3 commits behind head on develop.

Files	Patch %	Lines
paddlenlp/peft/lora/lqlora_utils.py	0.00%	41 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #8324      +/-   ##
===========================================
- Coverage    55.25%   55.23%   -0.03%     
===========================================
  Files          613      614       +1     
  Lines        95626    95667      +41     
===========================================
  Hits         52837    52837              
- Misses       42789    42830      +41     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[Liebele]

算法实现原理如下：

[lugimzzz]

double_quant=True，应该作为一个可调节参数，qlora_weight_quantize_dequantize中的其他参数也一样

[lugimzzz]

配置的时候需要考虑lora scaling，看起来lora scaling只能强制为1

[lugimzzz]

cast成fp32的原因？

[Liebele]

参考了论文原作者在pytorch下的实现
https://github.com/HanGuo97/lq-lora/blob/c2424b3adc27197815da1ac9e1304565168d824d/models/lq_utils.py#L117

[lugimzzz]

有没有实验结果可以参考一下效果

[lugimzzz]

提交之前，修复格式问题

cd PaddleNLP
pre-commit install

[Liebele]

在E2E数据集上的微调结果：