Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturbation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913739669766144 |
|---|---|
| author | Huang, Tiansheng Hu, Sihao Ilhan, Fatih Tekin, Selim Furkan Liu, Ling |
| author_facet | Huang, Tiansheng Hu, Sihao Ilhan, Fatih Tekin, Selim Furkan Liu, Ling |
| contents | Harmful fine-tuning attack poses serious safety concerns for large language models' fine-tuning-as-a-service. While existing defenses have been proposed to mitigate the issue, their performances are still far away from satisfactory, and the root cause of the problem has not been fully recovered. To this end, we in this paper show that harmful perturbation over the model weights could be a probable cause of alignment-broken. In order to attenuate the negative impact of harmful perturbation, we propose an alignment-stage solution, dubbed Booster. Technically, along with the original alignment loss, we append a loss regularizer in the alignment stage's optimization. The regularizer ensures that the model's harmful loss reduction after the simulated harmful perturbation is attenuated, thereby mitigating the subsequent fine-tuning risk. Empirical results show that Booster can effectively reduce the harmful score of the fine-tuned models while maintaining the performance of downstream tasks. Our code is available at https://github.com/git-disl/Booster. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_01586 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturbation Huang, Tiansheng Hu, Sihao Ilhan, Fatih Tekin, Selim Furkan Liu, Ling Computation and Language Artificial Intelligence Harmful fine-tuning attack poses serious safety concerns for large language models' fine-tuning-as-a-service. While existing defenses have been proposed to mitigate the issue, their performances are still far away from satisfactory, and the root cause of the problem has not been fully recovered. To this end, we in this paper show that harmful perturbation over the model weights could be a probable cause of alignment-broken. In order to attenuate the negative impact of harmful perturbation, we propose an alignment-stage solution, dubbed Booster. Technically, along with the original alignment loss, we append a loss regularizer in the alignment stage's optimization. The regularizer ensures that the model's harmful loss reduction after the simulated harmful perturbation is attenuated, thereby mitigating the subsequent fine-tuning risk. Empirical results show that Booster can effectively reduce the harmful score of the fine-tuned models while maintaining the performance of downstream tasks. Our code is available at https://github.com/git-disl/Booster. |
| title | Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturbation |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2409.01586 |