This is the official implementation for the following paper:
Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
Ziqi Gao^, Qichao Wang^, Aochuan Chen^, Zijing Liu, Bingzhe Wu, Liang Chen, Jia Li*
ICML 2024
The
peft
folder is a fork from huggingface's repository, which can be found peft.
NLU (GLUE) and image classification parts have been added.
cd ./peft
pip install -e .
pip install datasets scipy scikit-learn evaluate pillow torchvision optuna
Please kindly move to ./experiments
for the specific tasks.