This is the official implementation for the following paper:

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform

Ziqi Gao^, Qichao Wang^, Aochuan Chen^, Zijing Liu, Bingzhe Wu, Liang Chen, Jia Li*

ICML 2024

The peft folder is a fork from huggingface's repository, which can be found peft.

Dependencies

1. cd ./peft
2. pip install -e .
3. pip install datasets scipy scikit-learn evaluate pillow torchvision optuna wandb

Run

Please kindly move to ./experiments for the specific tasks.