Cover Image

Rejection Improves Reliability: Training LLMs to Refuse Unknown Questions Using RL from Knowledge Feedback

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xu, Hongshen, Zhu, Zichen, Zhang, Situo, Ma, Da, Fan, Shuai, Chen, Lu, Yu, Kai
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Reducing Tool Hallucination via Reliability Alignment
by: Xu, Hongshen, et al.
Published: (2024)

Compressing KV Cache for Long-Context LLM Inference with Inter-Layer Attention Similarity
by: Ma, Da, et al.
Published: (2024)

Sparsity-Accelerated Training for Large Language Models
by: Ma, Da, et al.
Published: (2024)

AdaEAGLE: Optimizing Speculative Decoding via Explicit Modeling of Adaptive Draft Structures
by: Zhang, Situo, et al.
Published: (2024)

Hierarchical Multimodal Pre-training for Visually Rich Webpage Understanding
by: Xu, Hongshen, et al.
Published: (2024)

Can LLMs Refuse Questions They Do Not Know? Measuring Knowledge-Aware Refusal in Factual Tasks
by: Pan, Wenbo, et al.
Published: (2025)

PACER: Blockwise Pre-verification for Speculative Decoding with Adaptive Length
by: Zhang, Situo, et al.
Published: (2026)

Enhancing LLM Reliability via Explicit Knowledge Boundary Modeling
by: Zheng, Hang, et al.
Published: (2025)

DiSRouter: Distributed Self-Routing for LLM Selections
by: Zheng, Hang, et al.
Published: (2025)

Alignment for Efficient Tool Calling of Large Language Models
by: Xu, Hongshen, et al.
Published: (2025)

FalseReject: A Resource for Improving Contextual Safety and Mitigating Over-Refusals in LLMs via Structured Reasoning
by: Zhang, Zhehao, et al.
Published: (2025)

Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training
by: Yuan, Youliang, et al.
Published: (2024)

Developing ChemDFM as a large language foundation model for chemistry
by: Zhao, Zihan, et al.
Published: (2024)

Multilingual Brain Surgeon: Large Language Models Can be Compressed Leaving No Language Behind
by: Zeng, Hongchuan, et al.
Published: (2024)

ProgRM: Build Better GUI Agents with Progress Rewards
by: Zhang, Danyang, et al.
Published: (2025)

XplainLLM: A Knowledge-Augmented Dataset for Reliable Grounded Explanations in LLMs
by: Chen, Zichen, et al.
Published: (2023)

Enhancing Transformation from Natural Language to Signal Temporal Logic Using LLMs with Diverse External Knowledge
by: Fang, Yue, et al.
Published: (2025)

Scientific Knowledge-driven Decoding Constraints Improving the Reliability of LLMs
by: Ma, Maotian, et al.
Published: (2026)

Latent Adversarial Training Improves the Representation of Refusal
by: Abbas, Alexandra, et al.
Published: (2025)

CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions
by: Zhang, Hanchong, et al.
Published: (2024)

Learn to Refuse: Making Large Language Models More Controllable and Reliable through Knowledge Scope Limitation and Refusal Mechanism
by: Cao, Lang
Published: (2023)

MoL-RL: Distilling Multi-Step Environmental Feedback into LLMs for Feedback-Independent Reasoning
by: Yang, Kang, et al.
Published: (2025)

Self-Reflective Planning with Knowledge Graphs: Enhancing LLM Reasoning Reliability for Question Answering
by: Zhu, Jiajun, et al.
Published: (2025)

How Post-Training Reshapes LLMs: A Mechanistic View on Knowledge, Truthfulness, Refusal, and Confidence
by: Du, Hongzhe, et al.
Published: (2025)

Does Refusal Training in LLMs Generalize to the Past Tense?
by: Andriushchenko, Maksym, et al.
Published: (2024)

UAQFact: Evaluating Factual Knowledge Utilization of LLMs on Unanswerable Questions
by: Tan, Chuanyuan, et al.
Published: (2025)

Delusions of Large Language Models
by: Xu, Hongshen, et al.
Published: (2025)

iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering
by: Wang, Shuai, et al.
Published: (2025)

CLaw: Benchmarking Chinese Legal Knowledge in Large Language Models - A Fine-grained Corpus and Reasoning Analysis
by: Xu, Xinzhe, et al.
Published: (2025)

A BiRGAT Model for Multi-intent Spoken Language Understanding with Hierarchical Semantic Frames
by: Xu, Hongshen, et al.
Published: (2024)

MobA: Multifaceted Memory-Enhanced Adaptive Planning for Efficient Mobile Task Automation
by: Zhu, Zichen, et al.
Published: (2024)

Evolving Subnetwork Training for Large Language Models
by: Li, Hanqi, et al.
Published: (2024)

Exploiting Tree Structure for Credit Assignment in RL Training of LLMs
by: Tran, Hieu, et al.
Published: (2025)

Refusal in LLMs is an Affine Function
by: Marshall, Thomas, et al.
Published: (2024)

Learning to Refuse: Towards Mitigating Privacy Risks in LLMs
by: Liu, Zhenhua, et al.
Published: (2024)

LLMs Encode Harmfulness and Refusal Separately
by: Zhao, Jiachen, et al.
Published: (2025)

Knowledge Dependency Estimation for Reliable Question Answering
by: Tong, Chaodong, et al.
Published: (2026)

LiveCLKTBench: Towards Reliable Evaluation of Cross-Lingual Knowledge Transfer in Multilingual LLMs
by: Guo, Pei-Fu, et al.
Published: (2025)

Improving Reliability and Explainability of Medical Question Answering through Atomic Fact Checking in Retrieval-Augmented LLMs
by: Vladika, Juraj, et al.
Published: (2025)

Automate Knowledge Concept Tagging on Math Questions with LLMs
by: Li, Hang, et al.
Published: (2024)