Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.16504 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913779622608896 |
|---|---|
| author | Du, Hao Liu, Shang Zheng, Lele Cao, Yang Nakamura, Atsuyoshi Chen, Lei |
| author_facet | Du, Hao Liu, Shang Zheng, Lele Cao, Yang Nakamura, Atsuyoshi Chen, Lei |
| contents | Fine-tuning has emerged as a critical process in leveraging Large Language Models (LLMs) for specific downstream tasks, enabling these models to achieve state-of-the-art performance across various domains. However, the fine-tuning process often involves sensitive datasets, introducing privacy risks that exploit the unique characteristics of this stage. In this paper, we provide a comprehensive survey of privacy challenges associated with fine-tuning LLMs, highlighting vulnerabilities to various privacy attacks, including membership inference, data extraction, and backdoor attacks. We further review defense mechanisms designed to mitigate privacy risks in the fine-tuning phase, such as differential privacy, federated learning, and knowledge unlearning, discussing their effectiveness and limitations in addressing privacy risks and maintaining model utility. By identifying key gaps in existing research, we highlight challenges and propose directions to advance the development of privacy-preserving methods for fine-tuning LLMs, promoting their responsible use in diverse applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_16504 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Privacy in Fine-tuning Large Language Models: Attacks, Defenses, and Future Directions Du, Hao Liu, Shang Zheng, Lele Cao, Yang Nakamura, Atsuyoshi Chen, Lei Artificial Intelligence Fine-tuning has emerged as a critical process in leveraging Large Language Models (LLMs) for specific downstream tasks, enabling these models to achieve state-of-the-art performance across various domains. However, the fine-tuning process often involves sensitive datasets, introducing privacy risks that exploit the unique characteristics of this stage. In this paper, we provide a comprehensive survey of privacy challenges associated with fine-tuning LLMs, highlighting vulnerabilities to various privacy attacks, including membership inference, data extraction, and backdoor attacks. We further review defense mechanisms designed to mitigate privacy risks in the fine-tuning phase, such as differential privacy, federated learning, and knowledge unlearning, discussing their effectiveness and limitations in addressing privacy risks and maintaining model utility. By identifying key gaps in existing research, we highlight challenges and propose directions to advance the development of privacy-preserving methods for fine-tuning LLMs, promoting their responsible use in diverse applications. |
| title | Privacy in Fine-tuning Large Language Models: Attacks, Defenses, and Future Directions |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2412.16504 |