Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2510.08646 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911480717246464 |
|---|---|
| author | Jiang, Eric Hanchen Ou, Weixuan Liu, Run Pang, Shengyuan Wan, Guancheng Duan, Ranjie Dong, Wei Chang, Kai-Wei Wang, XiaoFeng Wu, Ying Nian Li, Xinfeng |
| author_facet | Jiang, Eric Hanchen Ou, Weixuan Liu, Run Pang, Shengyuan Wan, Guancheng Duan, Ranjie Dong, Wei Chang, Kai-Wei Wang, XiaoFeng Wu, Ying Nian Li, Xinfeng |
| contents | Safety alignment of large language models currently faces a central challenge: existing alignment techniques often prioritize mitigating responses to harmful prompts at the expense of overcautious behavior, leading models to incorrectly refuse benign requests. A key goal of safe alignment is therefore to improve safety while simultaneously minimizing false refusals. In this work, we introduce Energy Landscape Steering (ELS), a novel, fine-tuning free framework designed to resolve this challenge through dynamic, inference-time intervention. We train a lightweight external Energy-Based Model (EBM) to assign high energy to undesirable states (false refusal or jailbreak) and low energy to desirable states (helpful response or safe reject). During inference, the EBM maps the LLM's internal activations to an energy landscape, and we use the gradient of the energy function to steer the hidden states toward low-energy regions in real time. This dynamically guides the model toward desirable behavior without modifying its parameters. By decoupling behavioral control from the model's core knowledge, ELS provides a flexible and computationally efficient solution. Extensive experiments across diverse models demonstrate its effectiveness, raising compliance on the ORB-H benchmark from 57.3 percent to 82.6 percent while maintaining baseline safety performance. Our work establishes a promising paradigm for building LLMs that simultaneously achieve high safety and low false refusal rates. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_08646 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Mitigating Over-Refusal in Aligned Large Language Models via Inference-Time Activation Energy Jiang, Eric Hanchen Ou, Weixuan Liu, Run Pang, Shengyuan Wan, Guancheng Duan, Ranjie Dong, Wei Chang, Kai-Wei Wang, XiaoFeng Wu, Ying Nian Li, Xinfeng Machine Learning Artificial Intelligence Computation and Language Safety alignment of large language models currently faces a central challenge: existing alignment techniques often prioritize mitigating responses to harmful prompts at the expense of overcautious behavior, leading models to incorrectly refuse benign requests. A key goal of safe alignment is therefore to improve safety while simultaneously minimizing false refusals. In this work, we introduce Energy Landscape Steering (ELS), a novel, fine-tuning free framework designed to resolve this challenge through dynamic, inference-time intervention. We train a lightweight external Energy-Based Model (EBM) to assign high energy to undesirable states (false refusal or jailbreak) and low energy to desirable states (helpful response or safe reject). During inference, the EBM maps the LLM's internal activations to an energy landscape, and we use the gradient of the energy function to steer the hidden states toward low-energy regions in real time. This dynamically guides the model toward desirable behavior without modifying its parameters. By decoupling behavioral control from the model's core knowledge, ELS provides a flexible and computationally efficient solution. Extensive experiments across diverse models demonstrate its effectiveness, raising compliance on the ORB-H benchmark from 57.3 percent to 82.6 percent while maintaining baseline safety performance. Our work establishes a promising paradigm for building LLMs that simultaneously achieve high safety and low false refusal rates. |
| title | Mitigating Over-Refusal in Aligned Large Language Models via Inference-Time Activation Energy |
| topic | Machine Learning Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2510.08646 |