Imagen de Portada

Instruction Following by Principled Boosting Attention of Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Guardieiro, Vitoria, Khare, Avishree, Stein, Adam, Wong, Eric
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Logicbreaks: A Framework for Understanding Subversion of Rule-based Inference
por: Xue, Anton, et al.
Publicado: (2024)

Improving Instruction-Following in Language Models through Activation Steering
por: Stolfo, Alessandro, et al.
Publicado: (2024)

Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models
por: Sun, Haoran, et al.
Publicado: (2024)

Softplus Attention with Re-weighting Boosts Length Extrapolation in Large Language Models
por: Gao, Bo, et al.
Publicado: (2025)

Once Upon an Input: Reasoning via Per-Instance Program Synthesis
por: Stein, Adam, et al.
Publicado: (2025)

Non-instructional Fine-tuning: Enabling Instruction-Following Capabilities in Pre-trained Language Models without Instruction-Following Data
por: Xie, Juncheng, et al.
Publicado: (2024)

SPaR: Self-Play with Tree-Search Refinement to Improve Instruction-Following in Large Language Models
por: Cheng, Jiale, et al.
Publicado: (2024)

From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuning
por: Wu, Xuansheng, et al.
Publicado: (2023)

Incentivizing Reasoning for Advanced Instruction-Following of Large Language Models
por: Qin, Yulei, et al.
Publicado: (2025)

Multi-Step Reasoning with Large Language Models, a Survey
por: Plaat, Aske, et al.
Publicado: (2024)

Toward the Evaluation of Large Language Models Considering Score Variance across Instruction Templates
por: Sakai, Yusuke, et al.
Publicado: (2024)

APTQ: Attention-aware Post-Training Mixed-Precision Quantization for Large Language Models
por: Guan, Ziyi, et al.
Publicado: (2024)

Improving Instruction Following in Language Models through Proxy-Based Uncertainty Estimation
por: Lee, JoonHo, et al.
Publicado: (2024)

Instruction Mining: Instruction Data Selection for Tuning Large Language Models
por: Cao, Yihan, et al.
Publicado: (2023)

RewardAnything: Generalizable Principle-Following Reward Models
por: Yu, Zhuohao, et al.
Publicado: (2025)

SAIF: A Sparse Autoencoder Framework for Interpreting and Steering Instruction Following of Language Models
por: He, Zirui, et al.
Publicado: (2025)

Infer Human's Intentions Before Following Natural Language Instructions
por: Wan, Yanming, et al.
Publicado: (2024)

Boosting Large Language Models with Mask Fine-Tuning
por: Zhang, Mingyuan, et al.
Publicado: (2025)

Instruction Tuning for Large Language Models: A Survey
por: Zhang, Shengyu, et al.
Publicado: (2023)

Nevermind: Instruction Override and Moderation in Large Language Models
por: Kim, Edward
Publicado: (2024)

Federated Data-Efficient Instruction Tuning for Large Language Models
por: Qin, Zhen, et al.
Publicado: (2024)

Enhancing and Assessing Instruction-Following with Fine-Grained Instruction Variants
por: Yang, Jiuding, et al.
Publicado: (2024)

BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoning
por: Zhang, Beichen, et al.
Publicado: (2025)

Principled Detection of Hallucinations in Large Language Models via Multiple Testing
por: Li, Jiawei, et al.
Publicado: (2025)

Financial Instruction Following Evaluation (FIFE)
por: Matlin, Glenn, et al.
Publicado: (2025)

Boosting of Thoughts: Trial-and-Error Problem Solving with Large Language Models
por: Chen, Sijia, et al.
Publicado: (2024)

PhySense: Principle-Based Physics Reasoning Benchmarking for Large Language Models
por: Xu, Yinggan, et al.
Publicado: (2025)

Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning
por: Zhi-Xuan, Tan, et al.
Publicado: (2024)

Sliding Window Attention Training for Efficient Large Language Models
por: Fu, Zichuan, et al.
Publicado: (2025)

Position Engineering: Boosting Large Language Models through Positional Information Manipulation
por: He, Zhiyuan, et al.
Publicado: (2024)

Is In-Context Learning Sufficient for Instruction Following in LLMs?
por: Zhao, Hao, et al.
Publicado: (2024)

Instructional Fingerprinting of Large Language Models
por: Xu, Jiashu, et al.
Publicado: (2024)

InstructAV: Instruction Fine-tuning Large Language Models for Authorship Verification
por: Hu, Yujia, et al.
Publicado: (2024)

Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Principles
por: Wei, Qingyan, et al.
Publicado: (2025)

Induced Numerical Instability: Hidden Costs in Multimodal Large Language Models
por: Wong, Wai Tuck, et al.
Publicado: (2026)

ReIFE: Re-evaluating Instruction-Following Evaluation
por: Liu, Yixin, et al.
Publicado: (2024)

Rethinking the Potential of Multimodality in Collaborative Problem Solving Diagnosis with Large Language Models
por: Wong, K., et al.
Publicado: (2025)

Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models
por: Dong, Guanting, et al.
Publicado: (2024)

OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents
por: Wang, Zihao, et al.
Publicado: (2024)

Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Models
por: Xu, Jiashu, et al.
Publicado: (2023)