Adapter model is just 400 bytes when using finetune.py

[KKcorps]

I am using the finetune.py script with default params

it works perfectly but when I get the adapter model in the checkpoint directory, the size of adapter model is just 400 bytes.

What can be the reason for this?

[s1ghhh]

check your peft version and try:
pip uninstall peft -y
pip install git+https://github.com/huggingface/peft.git@e536616888d51b453ed354a6f1e243fecb02ea08

[taishan1994]

check your peft version and try: pip uninstall peft -y pip install git+https://github.com/huggingface/peft.git@e536616888d51b453ed354a6f1e243fecb02ea08

it doesn't work. peft version must be 0.4.0.dev.0. but i also meet this problem.

[KKcorps]

Yes @taishan1994 is correct, we can't use older version of peft since it doesn't have the qlora changes.