awesome-neural-reprogramming-acoustic-prompting

A curated list of awesome adversarial reprogramming and input prompting methods for neural networks since 2022.

News - Dr. Pin-Yu Chen and Huck will give a tutortial on adversarial reprogramming at ICASSP 2022. Video

How to empower frozen large-scale pre-trained models with reprogramming and prompting toward different applications is the next big challenge of Deep Learning. Welcome to commit and pull request!

Neural Adapters in Decoder, Encoder, and Inputs

Title	Authors	Code	Year
Differentially Private Adapters for Parameter Efficient Acoustic Modeling	C.-W. Ho et al.	code	Interspeech 2023
Parameter-Efficient Learning for Text-to-Speech Accent Adaptation	L.-J. Yang et al.	code	Interspeech 2023
A Parameter-Efficient Learning Approach to Arabic Dialect Identification with Pre-Trained General-Purpose Speech Model	S. Radhakrishnan et al.	code	Interspeech 2023

Neural Reprogramming or Adversarial Reprogramming or Offsite-Tuning

Title	Authors	Code	Year
Reprogramming Self-supervised Learning-based Speech Representations for Speaker Anonymization	X. Chen et al.	-	ACM MM Asia 2023
Offsite-Tuning: Transfer Learning without Full Model	G. Xiao et al.	code	arxiv 2023
Music Instrument Classification Reprogrammed	H.-H. Chen et al.	-	MMM 2023
From English to More Languages: Parameter-Efficient Model Reprogramming for Cross-Lingual Speech Recognition	CHH Yang et al.	-	ICASSP 2023
Reprogrammable-FL: Improving Utility-Privacy Tradeoff in Federated Learning via Model Reprogramming	Huzaifa Arif et al.	code	SaTML 2023
Fairness Reprogramming	G. Zhang et al.	code	NeurIPS 2022
Low-Resource Music Genre Classification with Advanced Neural Model Reprogramming	Y.-N. Hung et al.	code	ICASSP 2023
Reprogramming Large Pretrained Language Models for Antibody Sequence Infilling	I. Melnyk et al.	-	Arxiv 2022
Adversarial Reprogramming Revisited	M. Englert et al.	-	NeurIPS 2022
Reprogramming Large Pretrained Language Models for Antibody Sequence Infilling	I. Melnyk et al.	-	Arxiv 2022
Rep-Net: Efficient On-Device Learning via Feature Reprogramming	L. Yang et al.	code	CVPR 2022
Improved Input Reprogramming for GAN Conditioning	T. Dinh et al.	-	Arxiv 2022
Cross-modal Adversarial Reprogramming	P. Neekhara et al.	code	WACV 2022
A Study of Low-Resource Speech Commands Recognition based on Adversarial Reprogramming	H Yen et al.	code	Interspeech 23
WARP: Word-level Adversarial ReProgramming	K. Hambardzumyan et al.	code	ACL 2021
Voice2series: Reprogramming acoustic models for time series classification	CHH Yang, et al.	code	ICML 2021
Transfer learning without knowing: Reprogramming black-box machine learning models with scarce data and limited resources	Y Tsai et al.	code	ICML 2020
Reprogramming GANs via Input Noise Design	K Lee et al.	-	ECML 2019
Adversarial Reprogramming of Text Classification Neural Networks	P. Neekhara et al.	code	EMNLP 2019
Adversarial reprogramming of neural networks	F. Elsayed et al.	code	ICLR 2019

Input-Level Neural Model Prompting for Vision and Speech

Title	Authors	Code	Year
SPEECHPROMPT V2: PROMPT TUNING FOR SPEECH CLASSIFICATION TASKS	K.-W. Chang et al.	code	Arxiv 2023
Understanding and Improving Visual Prompting: A Label-Mapping Perspective	A. Chen et al.	-	Arxiv 2022
AudioLM: a Language Modeling Approach to Audio Generation	Z. Borsos et al.	-	Arxiv 2022
WAVPROMPT: Towards Few-Shot Spoken Language Understanding with Frozen Language Models	H. Gao et al.	-	Arxiv 2022
An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks	K.-W. Chang et al.	code	Interspeech 2022
Visual Prompting: Modifying Pixel Space to Adapt Pre-trained Models	H. Bahng et al.	-	Arxiv 2022

Theory

Title	Authors	Code	Year
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution	A. Kumar et al.	-	ICLR 2022