REACT: Representation Extraction And Controllable Tuning to Overcome Overfitting in LLM Knowledge Editing
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915303842119680 |
|---|---|
| author | Zhong, Haitian Liu, Yuhuan Xu, Ziyang Liu, Guofan Liu, Qiang Wu, Shu Zhao, Zhe Wang, Liang Tan, Tieniu |
| author_facet | Zhong, Haitian Liu, Yuhuan Xu, Ziyang Liu, Guofan Liu, Qiang Wu, Shu Zhao, Zhe Wang, Liang Tan, Tieniu |
| contents | Large language model editing methods frequently suffer from overfitting, wherein factual updates can propagate beyond their intended scope, overemphasizing the edited target even when it's contextually inappropriate. To address this challenge, we introduce REACT (Representation Extraction And Controllable Tuning), a unified two-phase framework designed for precise and controllable knowledge editing. In the initial phase, we utilize tailored stimuli to extract latent factual representations and apply Principal Component Analysis with a simple learnbale linear transformation to compute a directional "belief shift" vector for each instance. In the second phase, we apply controllable perturbations to hidden states using the obtained vector with a magnitude scalar, gated by a pre-trained classifier that permits edits only when contextually necessary. Relevant experiments on EVOKE benchmarks demonstrate that REACT significantly reduces overfitting across nearly all evaluation metrics, and experiments on COUNTERFACT and MQuAKE shows that our method preserves balanced basic editing performance (reliability, locality, and generality) under diverse editing scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_18933 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | REACT: Representation Extraction And Controllable Tuning to Overcome Overfitting in LLM Knowledge Editing Zhong, Haitian Liu, Yuhuan Xu, Ziyang Liu, Guofan Liu, Qiang Wu, Shu Zhao, Zhe Wang, Liang Tan, Tieniu Artificial Intelligence Computation and Language Large language model editing methods frequently suffer from overfitting, wherein factual updates can propagate beyond their intended scope, overemphasizing the edited target even when it's contextually inappropriate. To address this challenge, we introduce REACT (Representation Extraction And Controllable Tuning), a unified two-phase framework designed for precise and controllable knowledge editing. In the initial phase, we utilize tailored stimuli to extract latent factual representations and apply Principal Component Analysis with a simple learnbale linear transformation to compute a directional "belief shift" vector for each instance. In the second phase, we apply controllable perturbations to hidden states using the obtained vector with a magnitude scalar, gated by a pre-trained classifier that permits edits only when contextually necessary. Relevant experiments on EVOKE benchmarks demonstrate that REACT significantly reduces overfitting across nearly all evaluation metrics, and experiments on COUNTERFACT and MQuAKE shows that our method preserves balanced basic editing performance (reliability, locality, and generality) under diverse editing scenarios. |
| title | REACT: Representation Extraction And Controllable Tuning to Overcome Overfitting in LLM Knowledge Editing |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2505.18933 |