Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.04045 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910634747101184 |
|---|---|
| author | Jiang, Houcheng Fang, Junfeng Zhang, Tianyu Zhang, An Wang, Ruipeng Liang, Tao Wang, Xiang |
| author_facet | Jiang, Houcheng Fang, Junfeng Zhang, Tianyu Zhang, An Wang, Ruipeng Liang, Tao Wang, Xiang |
| contents | This work explores sequential model editing in large language models (LLMs), a critical task that involves modifying internal knowledge within LLMs continuously through multi-round editing, each incorporating updates or corrections to adjust the model outputs without the need for costly retraining. Existing model editing methods, especially those that alter model parameters, typically focus on single-round editing and often face significant challenges in sequential model editing-most notably issues of model forgetting and failure. To address these challenges, we introduce a new model editing method, namely \textbf{N}euron-level \textbf{S}equential \textbf{E}diting (NSE), tailored for supporting sequential model editing. Specifically, we optimize the target layer's hidden states using the model's original weights to prevent model failure. Furthermore, we iteratively select neurons in multiple layers for editing based on their activation values to mitigate model forgetting. Our empirical experiments demonstrate that NSE significantly outperforms current modifying parameters model editing methods, marking a substantial advancement in the field of sequential model editing. Our code is released on \url{https://github.com/jianghoucheng/NSE}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_04045 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Neuron-Level Sequential Editing for Large Language Models Jiang, Houcheng Fang, Junfeng Zhang, Tianyu Zhang, An Wang, Ruipeng Liang, Tao Wang, Xiang Computation and Language This work explores sequential model editing in large language models (LLMs), a critical task that involves modifying internal knowledge within LLMs continuously through multi-round editing, each incorporating updates or corrections to adjust the model outputs without the need for costly retraining. Existing model editing methods, especially those that alter model parameters, typically focus on single-round editing and often face significant challenges in sequential model editing-most notably issues of model forgetting and failure. To address these challenges, we introduce a new model editing method, namely \textbf{N}euron-level \textbf{S}equential \textbf{E}diting (NSE), tailored for supporting sequential model editing. Specifically, we optimize the target layer's hidden states using the model's original weights to prevent model failure. Furthermore, we iteratively select neurons in multiple layers for editing based on their activation values to mitigate model forgetting. Our empirical experiments demonstrate that NSE significantly outperforms current modifying parameters model editing methods, marking a substantial advancement in the field of sequential model editing. Our code is released on \url{https://github.com/jianghoucheng/NSE}. |
| title | Neuron-Level Sequential Editing for Large Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2410.04045 |