superx612 / gradient-inversion-learning-resources

Gradient Inversion Learning Resources

This GitHub repository summarizes existing gradient leakage attacks and defenses in federated learning. For more details, please refer to our comprehensive survey.

We commit to diligently maintaining and updating this repository monthly to ensure it remains a valuable and up-to-date resource.

What are Gradient Inversion?

Gradient Leakage Attack is a privacy attack in federated learning systems where the attacker reconstructs the client's private data from shared gradient.

Why Gradient Inversion?

Gradient leakage attacks pose a significant threat to data privacy in federated learning. Investigating and defending against these potential gradient leakage attacks in federated learning is crucial for implementing secure distributed machine learning.

Note: Gradient leakage attacks are also commonly referred to as "Gradient Reconstruction Attacks" or "Gradient Inversion Attacks."

News

• 2024/07/06: I update this Github
• 2024/04/18: I create this GitHub repository.

Table of Contents

• Survey
• Tools
• Gradient Inversion for Computer Vision

  • Gradient Inversion in FedSGD

  • Gradient Inversion in FedAvg

• Gradient Inversion towards Other Tasks
• Defenses for Gradient Inversion

Survey

2024

• SoK: Gradient Leakage in Federated Learning [pdf]
  • Jiacheng Du, Jiahui Hu, Zhibo Wang, Peng Sun, Neil Zhenqiang Gong, and Kui Ren. arXiv, 2024.
• Review of Deep Gradient Inversion Attacks and Defenses in Federated Learning [pdf]
  • Yu Sun, Yu Yan, Jian Cui, Gaojian Xiong, Jianhua Liu. 电子学报, 2024.

2023

• A Comprehensive Study of Gradient Inversion Attacks in Federated Learning and Baseline Defense Strategies [pdf]

  • Ovi, Pretom Roy, and Aryya Gangopadhyay. 57th Annual Conference on Information Sciences and Systems (CISS), 2023.

• A Survey of Image Gradient Inversion Against Federated Learning [pdf]

  • Zhaohua Li, Le Wang, Guangyao Chen, Muhammad Shafq, and zhaoquan Gu. Authorea Preprints, 2023.

• Gradient leakage attacks in federated learning [pdf]

  • Haimei Gong, Liangjun Jiang, Xiaoyang Liu, Yuanqi Wang, Omary Gastro, Lei Wang, Ke Zhang, and Zhen Guo. Artificial Intelligence Review, 2023.

• Gradient Leakage Attacks in Federated Learning: Research Frontiers, Taxonomy and Future Directions [pdf]

  • Haomiao Yang, Mengyu Ge, Dongyun Xue, Kunlan Xiang, Hongwei Li, and Rongxing Lu. IEEE Network, 2023.

2022

• A Survey on Gradient Inversion: Attacks, Defenses and Future Directions [pdf]
  • Rui Zhang, Song Guo, Junxiao Wang, Xin Xie and Dacheng Tao. International Joint Conference on Artificial Intelligence, 2022.

Tools

• breaching

Gradient Inversion for Computer Vision

Gradient Inversion in FedSGD

2024

• SPEAR:Exact Gradient Inversion of Batches in Federated Learning [pdf]

  • Dimitar I. Dimitrov, Maximilian Baader, Mark Niklas Müller, Martin Vechev. arXiv, 2024.

• Hiding in Plain Sight: Disguising Data Stealing Attacks in Federated Learning [pdf] [code]

  • Kostadin Garov, Dimitar I. Dimitrov, Nikola Jovanovic, Martin Vechev. ICLR, 2024.

• Maximum Knowledge Orthogonality Reconstruction with Gradients in Federated Learning [pdf] [code]

  • Feng Wang, Senem Velipasalar, M. Cenk Gursoy. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2024.

• SIA: A sustainable inference attack framework in split learning [pdf]

  • Fangchao Yu, Lina Wang, Bo Zeng, Kai Zhao, Tian Wu, Zhi Pang. Neural Networks, 2024.

• Understanding Deep Gradient Leakage via Inversion Influence Functions [pdf] [code]

  • Haobo Zhang, Junyuan Hong, Yuyang Deng, Mehrdad Mahdavi, Jiayu Zhou. NeurIPS, 2024.

• Generative Image Reconstruction From Gradients [pdf]

  • Ekanut Sotthiwat, Liangli Zhen, Chi Zhang, Zengxiang Li, Rick Siow Mong Goh. TNNLS, 2024.

• LOKI: Large-scale Data Reconstruction Attack against Federated Learning through Model Manipulation [pdf] [code]

  • Joshua C. Zhao, Atul Sharma, Ahmed Roushdy Elkordy, Yahya H. Ezzeldin. IEEE Symposium on Security and Privacy, 2024.

• On Data Distribution Leakage in Cross-Silo Federated Learning [pdf]

  • Yangfan Jiang, Xinjian Luo, Yuncheng Wu, Xiaochen Zhu, Xiaokui Xiao, Beng Chin Ooi. IEEE Transactions on Knowledge and Data Engineering, 2024.

2023

• Scale-MIA: A Scalable Model Inversion Attack against Secure Federated Learning via Latent Space Reconstruction [pdf]

  • Shanghao Shi, Ning Wang, Yang Xiao, Chaoyu Zhang, Yi Shi, Y.Thomas Hou, Wenjing Lou. arXiv, 2023.

• Minimal Model Structure Analysis for Input Reconstruction in Federated Learning [pdf]

  • Jia Qian, Hiba Nassar, Lars kai Hansen. arXiv, 2023.

• The Resource Problem of Using Linear Layer Leakage Attack in Federated Learning [pdf]

  • Joshua C. Zhao, Ahmed Roushdy Elkordy, Atul Sharma, Yahya H. Ezzeldin, Salman Avestimehr, Saurabh Bagchi. CVPR, 2023.

• Fast Generation-Based Gradient Leakage Attacks against Highly Compressed Gradients [pdf] [code]

  • Dongyun Xue, Haomiao Yang, Mengyu Ge, Jingwei Li, Guowen Xu, Hongwei Li. Infocom, 2023.

• GAN You See Me? Enhanced Data Reconstruction Attacks against Split Inference [pdf] [code]

  • Ziang Li, Mengda Yang, Yaxin Liu, Juan Wang, Hongxin Hu, Wenzhe Yi, Xiaoyang Xu. NeurIPS, 2023.

• Generative Gradient Inversion via Over-Parameterized Networks in Federated Learning [pdf] [code]

  • Chi Zhang, Xiaoman Zhang, Ekanut Sotthiwat, Yanyu Xu, Ping Liu, Liangli Zhen, Yong Liu. ICCV, 2023.

• Cocktail Party Attack: Breaking Aggregation-Based Privacy in Federated Learning using Independent Component Analysis [pdf] [code]

  • Sanjay Kariyappa, Chuan Guo, Kiwan Maeng, Wenjie Xiong, G. Edward Suh, Moinuddin K Qureshi, Hsien-Hsin S. Lee. ICML, 2023.

• Dropout Is NOT All You Need to Prevent Gradient Leakage [pdf] [code]

  • Daniel Scheliga, Patrick Mader, Marco Seeland. AAAI, 2023.

• Gradient Obfuscation Gives a False Sense of Security in Federated Learning [pdf] [code]

  • Kai Yue, Richeng Jin, Chau-Wai Wong, Dror Baron, Huaiyu Dai. USENIX Security, 2023.

• EGIA: An External Gradient Inversion Attack in Federated Learning [pdf]

  • Haotian Liang, Youqi Li, Chuan Zhang, Ximeng Liu, Liehuang Zhu. TIFS, 2023.

• Learning To Invert: Simple Adaptive Attacks for Gradient Inversion in Federated Learning [pdf] [code]

  • Ruihan Wu, Xiangyu Chen, Chuan Guo, Kilian Q. Weinberger. Thirty-Ninth Conference on Uncertainty in Artificial Intelligence (PMLR), 2023.

• Using Highly Compressed Gradients in Federated Learning for Data Reconstruction Attacks [pdf] [code]

  • Haomiao Yang, Mengyu Ge, Kunlan Xiang, Jingwei Li. TIFS, 2023.

• When the Curious Abandon Honesty: Federated Learning Is Not Private [pdf] [code]

  • Franziska Boenisch, Adam Dziedzic, Roei Schuster, Ali Shahin Shamsabadi, Ilia Shumailov, Nicolas Papernot. EuroS&P, 2023.

• Reconstructing Individual Data Points in Federated Learning Hardened with Differential Privacy and Secure Aggregation [pdf]

  • Franziska Boenisch, Adam Dziedzic, Roei Schuster, Ali Shahin Shamsabadi, Ilia Shumailov, Nicolas Papernot. EuroS&P, 2023.

• When the Curious Abandon Honesty: Federated Learning Is Not Private [pdf] [code]

  • Franziska Boenisch, Adam Dziedzic, Roei Schuster, Ali Shahin Shamsabadi, Ilia Shumailov. IEEE 8th European Symposium on Security and Privacy (EuroS&P), 2023.

• Retracted: Defending Privacy Inference Attacks to Federated Learning for Intelligent IoT with Parameter Compression [pdf]

  • Yongsheng Zhu, Hongbo Cao, Yuange Ren, Wanqi Wang, Bin Wang, Mingqing Hu, Baigen Cai, Wei Wang. Security and Communication Networks, 2023.

• Do Gradient Inversion Attacks Make Federated Learning Unsafe? [pdf]

  • Ali Hatamizadeh, Hongxu Yin, Pavlo Molchanov, Andriy Myronenko, Wenqi Li, Prerna Dogra, Andrew Feng, Mona G. Flores, Jan Kautz, Daguang Xu, and Holger R. Roth. TMI, 2023.

• Improved Gradient Inversion Attacks and Defenses in Federated Learning [pdf]

  • Jiahui Geng, Yongli Mou, Qing Li, Feifei Li, Oya Beyan, Stefan Decker, Chunming Rong. IEEE Transactions on Big Data, 2023.

2022

• Towards General Deep Leakage in Federated Learning [pdf]

  • Jiahui Geng, Yongli Mou, Feifei Li, Qing Li, Oya Beyan, Stefan Decker, Chunming Rong. arXiv, 2022.

• Bayesian framework for gradient leakage [pdf] [code]

  • Mislav Balunovi ́ c, Dimitar I. Dimitrov, Robin Staab, Martin Vechev. ICLR, 2022.

• Compromise Privacy in Large-Batch Federated Learning via Malicious Model Parameters [pdf]

  • Shuaishuai Zhang, Jie Huang, ZepingZhang, and Chunyang Qi. International Conference on Algorithms and Architectures for Parallel Processing, 2022.

• Stealing Secrecy from Outside: A Novel Gradient Inversion Attack in Federated Learning [pdf]

  • Chuan Zhang, Haotian Liang, Youqi Li, Tong Wu, Liehuang Zhu, Weiting Zhang. International Conference on Parallel and Distributed Systems (ICPADS), 2022.

• Theory-Oriented Deep Leakage from Gradients via Linear Equation Solver [pdf]

  • Xudong Pan, Mi Zhang, Yifan Yan, Jiaming Zhu, and Min Yang. 31st USENIX Security Symposium, 2022.

• Fishing for User Data in Large-Batch Federated Learning via Gradient Magnification [pdf] [code]

  • Yuxin Wen, Jonas A. Geiping, Liam Fowl, Micah Goldblum, Tom Goldstein. International Conference on Machine Learning. PMLR, 2022.

• Robbing the Fed: Directly Obtaining Private Data in Federated Learning with Modified Models [pdf] [code1] [code2]

  • Liam H Fowl, Jonas Geiping, Wojciech Czaja, Micah Goldblum, Tom Goldstein. ICLR, 2022.

• Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakage [pdf] [code]

  • Zhuohang Li, Jiaxin Zhang, Luyang Liu, Jian Liu. CVPR, 2022.

• Privacy Leakage of Adversarial Training Models in Federated Learning Systems [pdf] [code]

  • Jingyang Zhang, Yiran Chen, Hai Li. CVPR, 2022.

• APRIL: Finding the Achilles' Heel on Privacy for Vision Transformers [pdf] [code]

  • Jiahao Lu, Xi Sheryl Zhang, Tianli Zhao, Xiangyu He, Jian Cheng. CVPR, 2022.

• GradViT: Gradient Inversion of Vision Transformers [pdf]

  • Ali Hatamizadeh, Hongxu Yin, Holger Roth, Wenqi Li, Jan Kautz, Daguang Xu, Pavlo Molchanov. ICCV, 2022.

• BI-GAN: batch inversion membership inference attack on federated learning [pdf]

  • Hiep Vo, Mingjian Tang, Xi (James) Zheng, Shui Yu. 17th ACM Workshop on Mobility in the Evolving Internet Architecture, MobiArch 2022.

• Enhancing Trajectory Recovery From Gradients via Mobility Prior Knowledge [pdf]

  • Kaiyue Zhang, Zipei Fan, Xuan Song, Shui Yu. IEEE Internet of Things Journal, 2022.

• GRNN: Generative Regression Neural Network - A Data Leakage Attack for Federated Learning [pdf] [code]

  • Hanchi Ren, Jingjing Deng, Xianghua Xie. ACM Transactions on Intelligent Systems and Technology (TIST), 2022.

• CGIR: Conditional Generative Instance Reconstruction Attacks Against Federated Learning [pdf]

  • Xiangrui Xu, Pengrui Liu, Wei Wang, Hong-Liang Ma, Bin Wang, Zhen Han, Yufei Han. TDSC, 2022.

• Shielding Federated Learning: Aligned Dual Gradient Pruning Against Gradient Leakage [pdf]

  • Shengshan Hu*,* Lulu Xue, Ruizhi Zhao, Leo Yu Zhang, Chaowei Xiao, Lichao Sun, Minghui Li, Hai Jin. OpenReview 2022.

2021

• Revealing and Protecting Labels in Distributed Training [pdf] [code]

  • Trung Dang, Om Thakkar, Swaroop Ramaswamy, Rajiv Mathews, Peter Chin, Françoise Beaufays. NeurIPS, 2021.

• Gradient Inversion with Generative Image Prior [pdf] [code]

  • Jinwoo Jeon, Jaechang Kim, Kangwook Lee, Sewoong Oh, Jungseul Ok. NeurIPS, 2021.

• CAFE: Catastrophic Data Leakage in Vertical Federated Learning [pdf] [code]

  • Xiao Jin, Pin-Yu Chen, Chia-Yi Hsu, Chia-Mu Yu, Tianyi Chen. NeurIPS, 2021.

• Evaluating Gradient Inversion Attacks and Defenses in Federated Learning [pdf] [code]

  • Yangsibo Huang, Samyak Gupta, Zhao Song, Kai Li, Sanjeev Arora. NeurIPS, 2021.

• Understanding Training-Data Leakage from Gradients in Neural Networks for ImageClassifications [pdf]

  • Cangxiong Chen, Neill D. F. Campbell. NeurIPS Workshop Privacy in Machine Learning, 2021.

• From Gradient Leakage To Adversarial Attacks In Federated Learning [pdf] [code]

  • Jia Qi Lim, Chee Seng Chan. IEEE International Conference on Image Processing, 2021.

• Gradient-Leakage Resilient Federated Learning [pdf] [code]

  • Wenqi Wei, Ling Liu, Yanzhao Wu, Gong Su, Arun Iyengar. International Conference on Distributed Computing Systems, 2021.

• See Through Gradients: Image Batch Recovery via GradInversion [pdf] [code]

  • Hongxu Yin, Arun Mallya, Arash Vahdat, Jose M. Alvarez, Jan Kautz, Pavlo Molchanov. CVPR, 2021.

2020

• Information Leakage by Model Weights on Federated Learning [pdf]

  • Xiaoyun Xu, Jingzheng Wu, Mutian Yang, Tianyue Luo, Xu Duan, Weiheng Li. Proceedings of the 2020 workshop on privacy-preserving machine learning in practice, 2020.

• R-GAP: Recursive Gradient Attack on Privacy [pdf] [[code]](On Data Distribution Leakage in Cross-Silo Federated Learning)

  • Junyi Zhu, Matthew Blaschko. ICLR, 2020.

• Inverting Gradients - How easy is it to break privacy in federated learning? [pdf] [code]

  • Jonas Geiping, Hartmut Bauermeister, Hannah Dröge, Michael Moeller. NeurIPS, 2020.

• PLFG: A Privacy Attack Method Based on Gradients for Federated Learning [pdf]

  • Feng Wu. Security and Privacy in Digital Economy: First International Conference, SPDE 2020.

2019

• Deep Leakage from Gradients [pdf] [code]

  • Ligeng Zhu, Zhijian Liu, Song Han. NeurIPS, 2019.

2017

• Privacy-Preserving Deep Learning: Revisited and Enhanced [pdf]
  • Le Trieu Phong, Yoshinori Aono, Takuya Hayashi, Lihua Wang, and Shiho Moriai. Applications and Techniques in Information Security: 8th International Conference, 2017.

Gradient Inversion in FedAvg

2023

• Approximate and Weighted Data Reconstruction Attack in Federated Learning [pdf]
  • Yongcun Song, Ziqi Wang, and Enrique Zuazua. arXiv, 2023.
• LOKI: Large-scale Data Reconstruction Attack against Federated Learning through Model Manipulation [pdf] [code]
  • Joshua C. Zhao, Atul Sharma, Ahmed Roushdy Elkordy, Yahya H. Ezzeldin, Salman Avestimehr, Saurabh Bagchi. arXiv, 2023.
• Surrogate Model Extension (SME): A Fast and Accurate Weight Update Attack on Federated Learning [pdf] [code]
  • Junyi Zhu, Ruicong Yao, Matthew B. Blaschko. International Conference on Machine Learning, 2023.

2022

• AGIC: Approximate Gradient Inversion Attack on Federated Learning [pdf]
  • Jin Xu, Chi Hong, Jiyue Huang, Lydia Y. Chen, J ́ er ́ emie Decouchant. International Symposium on Reliable Distributed Systems (SRDS), 2022.
• Data Leakage in Federated Averaging [pdf] [code]
  • Dimitar I. Dimitrov, Mislav Balunović, Nikola Konstantinov, Martin Vechev. Transactions on Machine Learning Research, 2022.

Gradient Inversion towards Other Tasks

Gradient Inversion in Natural Language Processing (NLP)

2024

• DAGER: Exact Gradient Inversion for Large Language Models [pdf]

  • Ivo Petrov, Dimitar I. Dimitrov, Maximilian Baader, Mark Niklas Müller, Martin Vechev. arXiv, 2024.

• FLTrojan: Privacy Leakage Attacks against Federated Language Models Through Selective Weight Tampering [pdf]

  • Md Rafi Ur Rashid, Vishnu Asutosh Dasu, Kang Gu, Najrin Sultana, Shagufta Mehnaz. arXiv, 2024.

• FLAT-Chat: A Word Recovery Attack on Federated Language Model Training [pdf]

  • Qiongkai Xu, Jun Wang, Olga Ohrimenko, Trevor Cohn. Rejected by ICLR, 2024.

• Privacy-Preserving Federal Learning Chain for Internet of Things [pdf]

  • Yihang Xu, Yuxing Mao, Simou Li, Jian Li, Xueshuo Chen. IEEE Internet of Things Journal, 2024.

2023

• Beyond Gradient and Priors in Privacy Attacks: Leveraging Pooler Layer Inputs of Language Models in Federated Learning [pdf]

  • Jianwei Li, Sheng Liu, Qi Lei. arXiv, 2023.

• Decepticons: Corrupted Transformers Breach Privacy in Federated Learning for Language Models [pdf] [code]

  • Liam Fowl, Jonas Geiping, Steven Reich, Yuxin Wen, Wojtek Czaja, Micah Goldblum, Tom Goldstein. ICLR, 2023.

• Panning for Gold in Federated Learning: Targeted Text Extraction under Arbitrarily Large-Scale Aggregation [pdf]

  • Hong-Min Chu, Jonas Geiping, Liam Fowl, Micah Goldblum, Tom Goldstein. ICLR, 2023.

• Reconstructing Training Data from Model Gradient, Provably [pdf]

  • Zihan Wang, Jason D. Lee, Qi Lei. International Conference on Artificial Intelligence and Statistics, PMLR, 2023.

• Revealing and Protecting Labels in Distributed Training [pdf] [code]

  • Trung Dang, Om Thakkar, Swaroop Ramaswamy, Rajiv Mathews, Peter Chin, Françoise Beaufays. NeurIPS, 2021.

• TAG: Gradient Attack on Transformer-based Language Models [pdf] [code]

  • Jieren Deng, Yijue Wang, Ji Li, Chenghong Wang, Chao Shang, Hang Liu, Sanguthevar Rajasekaran, Caiwen Ding. The 2021 Conference on Empirical Methods in Natural Language Processing, 2021.

2022

• LAMP: Extracting Text from Gradients with Language Model Priors [pdf] [[code]](FLTrojan: Privacy Leakage Attacks against Federated Language Models Through Selective Weight Tampering)
  • Mislav Balunovi ́, Dimitar I. Dimitrov,∗Nikola Jovanovi ́ c, Martin Vechev. NeurIPS, 2022.
• Recovering Private Text in Federated Learning of Language Models [pdf] [code]
  • Samyak Gupta, Yangsibo Huang, Zexuan Zhong, Tianyu Gao, Kai Li, Danqi Chen. NeurIPS, 2022.

2019

• Deep Leakage from Gradients [pdf] [code]

  • Ligeng Zhu, Zhijian Liu, Song Han. NeurIPS, 2019.

Gradient Inversion in Table

• TabLeak: Tabular Data Leakage in Federated Learning [pdf] [code]
  • Mark Vero, Mislav Balunovic´, Dimitar I. Dimitrov, Martin Vechev. ICML, 2023.

Gradient Inversion in Speech Processing

• Speech Privacy Leakage from Shared Gradients in Distributed Learning [pdf]
  • Zhuohang Li, Jiaxin Zhang, Jian Liu. ICASSP, 2023.

Defenses for Gradient Inversion

2024

• Concealing Sensitive Samples against Gradient Leakage in Federated Learning [pdf] [code]
  • Jing Wu, Munawar Hayat, Mingyi Zhou, Mehrtash Harandi. AAAI, 2024.
• Mixing Gradients in Neural Networks as a Strategy To Enhance Privacy in Federated Learning [pdf]
  • Shaltiel Eloul, Fran Silavong, Sanket Kamthe, Antonios Georgiadis, and Sean J. Moran CTO, JPMorgan Chase. IEEE/CVF Winter Conference on Applications of Computer Vision, 2024.
• Differentially Private Federated Learning With an Adaptive Noise Mechanism [pdf]
  • Rui Xue, Kaiping Xue, Bin Zhu, Xinyi Luo, Tianwei Zhang, Qibin Sun, Jun Lu. TIFS, 2024.
• Vulnerabilities of Data Protection in Vertical Federated Learning Training and Countermeasures [pdf]
  • Derui Zhu, Jinfu Chen, Xuebing Zhou, Weiyi Shang, Ahmed E. Hassan, Jens Grossklags. TIFS, 2024.
• HashVFL: Defending Against Data Reconstruction Attacks in Vertical Federated Learning [pdf]
  • Pengyu Qiu, Xuhong Zhang, Shouling Ji, Chong Fu, Xing Yang, Ting Wang. TIFS, 2024.
• TAPFed : Threshold Secure Aggregation for Privacy-Preserving Federated Learning [pdf]
  • Runhua Xu, Bo Li, Chao Li, James Joshi, Shuai Ma, Jianxin Li. TDSC, 2024.
• SIREN+: Robust Federated Learning with Proactive Alarming and Differential Privacy [pdf] [code]
  • Hanxi Guo, Hao Wang, Tao Song, Yang Hua Ruhui Ma, Xiulang Jin, Zhengui Xue, Haibing Guan. IEEE Transactions on Dependable and Secure Computing, 2024.
• FLSG: A Novel Defense Strategy Against Inference Attacks in Vertical Federated Learning [pdf]
  • Kai Fan, Jingtao Hong, Wenjie Li, Xingwen Zhao, Hui Li, Yintang Yang. IEEE Internet of Things Journal, 2024.
• PA-iMFL: Communication-Efficient Privacy Amplification Method Against Data Reconstruction Attack in Improved Multi-Layer Federated Learning [pdf]
  • Jianhua Wang, Xiaolin Chang, Jelena Mišić, Vojislav B. Mišić, Zhi Chen, and Junchao Fan. IEEE Internet of Things Journal, 2024.
• More than Enough is Too Much: Adaptive Defenses against Gradient Leakage in Production Federated Learning [pdf] [code]
  • Fei Wang, Ethan Hugh, Baochun Li. IEEE/ACM Transactions on Networking, 2024.
• GFL-ALDPA: a gradient compression federated learning framework based on adaptive local differential privacy budget allocation [pdf]
  • Jiawei Yang, Shuhong Chen, Guojun Wang, Zijia Wang, Zhiyong Jie, Muhammad Arif. Multimedia Tools and Applications, 2024.
• Protecting Label Distribution in Cross-Silo Federated Learning [pdf]
  • Yangfan Jiang, Xinjian Luo, Yuncheng Wu, Xiaokui Xiao, and Beng Chin Ooi. IEEE Symposium on Security and Privacy (SP), 2024.

2023

• OASIS: Offsetting Active Reconstruction Attacks in Federated Learning [pdf]
  • Tre’ R. Jeter, Truc Nguyen, Raed Alharbi, My T. Thai. arXiv, 2023.
• Gradient Leakage Defense with Key-Lock Module for Federated Learning [pdf] [code]
  • Hanchi Ren, Jingjing Deng, Xianghua Xie, Xiaoke Ma, Jianfeng Ma. arXiv, 2023.
• Enhancing Privacy Preservation in Federated Learning via Learning Rate Perturbation [pdf]
  • Guangnian Wan, Haitao Du, Xuejing Yuan, Jun Yang, Meiling Chen, Jie Xu. ICCV, 2023.
• DPAUC: Differentially Private AUC Computation in Federated Learning [pdf] [code]
  • Jiankai Sun, Xin Yang, Yuanshun Yao, Junyuan Xie, Di Wu, Chong Wang. AAAI, 2023.
• Dropout Is NOT All You Need to Prevent Gradient Leakage [pdf]
  • Daniel Scheliga, Patrick M ̈ ader, Marco Seeland. AAAI, 2023.
• Mixed Quantization Enabled Federated Learning To Tackle Gradient Inversion Attacks [pdf]
  • Pretom Roy Ovi, Emon Dey, Nirmalya Roy, Aryya Gangopadhyay. CVPR, 2023.
• Privacy-Preserving Federated Learning via Disentanglement [pdf]
  • Wenjie Zhou, Piji Li, Zhaoyang Han, Xiaozhen Lu, Juan Li, Zhaochun Ren, Zhe Liu. Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 2023.
• Gradient-less Federated Gradient Boosting Tree with Learnable Learning Rates [pdf] [code]
  • Chenyang Ma, Xinchi Qiu, Daniel J. Beutel, Nicholas D. Lane. Proceedings of the 3rd Workshop on Machine Learning and Systems. 2023.
• Privacy-Encoded Federated Learning Against Gradient-Based Data Reconstruction Attacks [pdf]
  • Hongfu Liu, Bin Li, Changlong Gao, Pei Xie, Chenglin Zhao. TIFS, 2023.
• Compressed Sensing-Based Practical and Efficient Privacy-Preserving Federated Learning [pdf]
  • Siguang Chen, Yifeng Miao, Xue Li, Chuanxin Zhao. IEEE Internet of Things Journal, 2023.
• Accuracy–Security Tradeoff With Balanced Aggregation and Artificial Noise for Wireless Federated Learning [pdf]
  • Zhigang Yan, Dong Li, Zhichao Zhang, Jiguang He. IEEE Internet of Things Journal, 2023.
• Automatic Transformation Search Against Deep Leakage From Gradients [pdf] [code]
  • Wei Gao, Xu Zhang, Shangwei Guo, Tianwei Zhang, Tao Xiang, Han Qiu, Yonggang Wen, Yang Liu. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
• Blockchain-Based Swarm Learning for the Mitigation of Gradient Leakage in Federated Learning [pdf]
  • Hussain Ahmad Madni, Rao Muhammad Umer, Gian Luca Foresti. IEEE Access, 2023.
• DEFEAT: A decentralized federated learning against gradient attacks [pdf]
  • Guangxi Lu, Zuobin Xiong, Ruinian Li, Nael Mohammad, Yingshu Li, Wei Li. High-Confidence Computing, 2023.
• EFMVFL: An Efficient and Flexible Multi-party Vertical Federated Learning without a Third Party [pdf]
  • Yimin Huang, Wanwan Wang, Xingying Zhao, Yukun Wang, Xinyu Feng, Hao He, Ming Yao, Authors Info & Claims. ACM Transactions on Knowledge Discovery from Data, 2023.
• Fedlabx: a practical and privacy-preserving framework for federated learning [pdf]
  • Yuping Yan, Mohammed B. M. Kamel, Marcell Zoltay, Marcell Gál, Roland Hollós, Yaochu Jin, Ligeti Péter, Ákos Tényi. Complex & Intelligent Systems, 2023.
• Performance Optimization for Noise Interference Privacy Protection in Federated Learning [pdf]
  • Zihao Peng, Boyuan Li, Le Li, Shengbo Chen, Guanghui Wang, Hong Rao, Cong Shen. IEEE Transactions on Cognitive Communications and Networking, 2023.
• RoFL: Robustness of Secure Federated Learning [pdf] [code1] [code2]
  • Hidde Lycklama, Lukas Burkhalter, Alexander Viand, Nicolas K ̈ uchler, Anwar Hithnawi. IEEE Symposium on Security and Privacy (SP), 2023.
• VFLR: An Efficient and Privacy-Preserving Vertical Federated Framework for Logistic Regression [pdf]
  • Jiaqi Zhao, Hui Zhu, Fengwei Wang, Rongxing Lu, ErmeiWang, Linfeng Li, Hui Li. IEEE Transactions on Cloud Computing, 2023.
• Shield Against Gradient Leakage Attacks: Adaptive Privacy-Preserving Federated Learning [pdf]
  • Jiahui Hu, Zhibo Wang, Yongsheng Shen, Bohan Lin, Peng Sun, Xiaoyi Pang, Jian Liu, Kui Ren. IEEE/ACM Transactions on Networking, 2023.

2022

• Refiner: Data Refining against Gradient Leakage Attacks in Federated Learning [pdf]
  • Mingyuan Fan, Cen Chen, Chengyu Wang, Wenmeng Zhou, Jun Huang, Ximeng Liu, Wenzhong Guo. arXiv, 2022.
• Mixed Precision Quantization to Tackle Gradient Leakage Attacks in Federated Learning [pdf]
  • Pretom Roy Ovi, Emon Dey, Nirmalya Roy, Aryya Gangopadhyay. arXiv, 2022.
• Enhancing Privacy against Inversion Attacks in Federated Learning by using Mixing Gradients Strategies [pdf]
  • Shaltiel Eloul, Fran Silavong, Sanket Kamthe, Antonios Georgiadis, Sean J. Moran. arXiv, 2022.
• Combining Variational Modeling with Partial Gradient Perturbation to Prevent Deep Gradient Leakage [pdf]
  • Daniel Scheliga, Patrick M ̈ ader, Marco Seeland. arXiv, 2022.
• Defense Against Gradient Leakage Attacks via Learning to Obscure Data [pdf]
  • Yuxuan Wan, Han Xu, Xiaorui Liu, Jie Ren, Wenqi Fan, Jiliang Tang. arXiv, 2022.
• Defense against Privacy Leakage in Federated Learning [pdf]
  • Jing Wu, Munawar Hayat, Mingyi Zhou, Mehrtash Harandi. arXiv, 2022.
• SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compression [pdf] [code]
  • Zhize Li, Haoyu Zhao, Boyue Li, Yuejie Chi. NeurIPS, 2022.
• PRECODE - A Generic Model Extension to Prevent Deep Gradient Leakage [pdf] [code]
  • Daniel Scheliga, Patrick M ̈ ader, Marco Seeland. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2022.
• Protect Privacy from Gradient Leakage Attack in Federated Learning [pdf]
  • Junxiao Wang, Song Guo, Xin Xie, Heng Qi. IEEE INFOCOM, 2022.
• FedDef: Defense Against Gradient Leakage in Federated Learning-based Network Intrusion Detection Systems [pdf]
  • Jiahui Chen, Yi Zhao, Qi Li, Ke Xu. TIFS, 2022.
• PVD-FL: A Privacy-Preserving and Verifiable Decentralized Federated Learning Framework [pdf]
  • Jiaqi Zhao, Hui Zhu, Fengwei Wang, Rongxing Lu, Zhe Liu, Hui Li. TIFS, 2022.
• Defending Batch-Level Label Inference and Replacement Attacks in Vertical Federated Learning [pdf]
  • Tianyuan Zou, Yang Liu, Yan Kang, Wenhan Liu, Yuanqin He, Zhihao Yi, Qiang Yang, Ya-Qin Zhang. IEEE Transactions on Big Data, 2022.
• Practical Private Aggregation in Federated Learning Against Inference Attack [pdf]
  • Ping Zhao, Zhikui Cao, Jin Jiang, and Fei Gao. IEEE Internet of Things Journal, 2022.

2021

• Defending against Reconstruction Attack in Vertical Federated Learning [pdf]
  • Jiankai Sun, Yuanshun Yao, Weihao Gao, Junyuan Xie, Chong Wang. ICML, 2021.
• Privacy-preserving Collaborative Learning with Automatic Transformation Search [pdf] [code1] [code2] [code3]
  • Wei Gao, Shangwei Guo, Tianwei Zhang, Han Qiu, Yonggang Wen, Yang Liu. CVPR, 2021.
• Soteria: Provable Defense against Privacy Leakage in Federated Learning from Representation Perspective [pdf] [code]
  • Jingwei Sun, Ang Li, Binghui Wang, Huanrui Yang, Hai Li, Yiran Chen. CVPR, 2021.
• PPFL: privacy-preserving federated learning with trusted execution environments [pdf] [code]
  • Fan Mo, Hamed Haddadi, Kleomenis Katevas, Eduard Marin, Diego Perino, Nicolas Kourtellis. Proceedings of the 19th annual international conference on mobile systems, applications, and services, 2021.
• A Fine-Grained Differentially Private Federated Learning Against Leakage From Gradients [pdf] [code]
  • Linghui Zhu, Xinyi Liu, Yiming Li, Xue Yang, Shu-Tao Xia, Rongxing Lu. IEEE Internet of Things Journal, 2021.
• Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing [pdf] [code]
  • Yong Li, Yipeng Zhou, Alireza Jolfaei, Dongjin Yu, Gaochao Xu, Xi Zheng. IEEE Internet of Things Journal, 2021.
• Digestive neural networks: A novel defense strategy against inference attacks in federated learning [pdf]
  • Hongkyu Lee, Jeehyeong Kim, Seyoung Ahn, Rasheed Hussain, Sunghyun Cho, Junggab Son. computers & security, 2021.
• Gradient Leakage Attack Resilient Deep Learning [pdf]
  • Wenqi Wei, Ling Liu. TIFS, 2021.

2020

• Provable Defense against Privacy Leakage in Federated Learning from Representation Perspective [pdf] [code]
  • Jingwei Sun, Ang Li, Binghui Wang, Huanrui Yang, Hai Li, Yiran Chen. arXiv, 2020.
• InstaHide: Instance-hiding Schemes for Private Distributed Learning [pdf] [code]
  • Yangsibo Huang, Zhao Song, Kai Li, Sanjeev Arora. ICML, 2020.
• Labels are Culprits: Defending Gradient Attack On Privacy [pdf] [code]
  • Zhaohua Li, Le Wang, Zhaoquan Gu, Yang Lv, Zhihong Tian. ICML, 2020.

2015

• An Optimized Sparse Response Mechanism for Differentially Private Federated Learning [pdf]
  • Jiating Ma, Yipeng Zhou, Laizhong Cui, Song Guo. TDSC, 2015.