Buchumschlag

Non-instructional Fine-tuning: Enabling Instruction-Following Capabilities in Pre-trained Language Models without Instruction-Following Data

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Xie, Juncheng, Syu, Shensian, Lee, Hung-yi
Format:	Preprint
Veröffentlicht:	2024
Schlagworte:	Computation and Language Artificial Intelligence Machine Learning
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

Enhancing and Assessing Instruction-Following with Fine-Grained Instruction Variants
von: Yang, Jiuding, et al.
Veröffentlicht: (2024)

InstructAV: Instruction Fine-tuning Large Language Models for Authorship Verification
von: Hu, Yujia, et al.
Veröffentlicht: (2024)

Improving Instruction-Following in Language Models through Activation Steering
von: Stolfo, Alessandro, et al.
Veröffentlicht: (2024)

Instruction Following by Principled Boosting Attention of Large Language Models
von: Guardieiro, Vitoria, et al.
Veröffentlicht: (2025)

From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuning
von: Wu, Xuansheng, et al.
Veröffentlicht: (2023)

Improving Instruction Following in Language Models through Proxy-Based Uncertainty Estimation
von: Lee, JoonHo, et al.
Veröffentlicht: (2024)

Prompt-Based One-Shot Exact Length-Controlled Generation with LLMs
von: Xie, Juncheng, et al.
Veröffentlicht: (2025)

Sparse is Enough in Fine-tuning Pre-trained Large Language Models
von: Song, Weixi, et al.
Veröffentlicht: (2023)

InstructionCP: A fast approach to transfer Large Language Models into target language
von: Chen, Kuang-Ming, et al.
Veröffentlicht: (2024)

Financial Instruction Following Evaluation (FIFE)
von: Matlin, Glenn, et al.
Veröffentlicht: (2025)

Improving Non-autoregressive Translation Quality with Pretrained Language Model, Embedding Distillation and Upsampling Strategy for CTC
von: Syu, Shen-sian, et al.
Veröffentlicht: (2023)

A Study of Backdoors in Instruction Fine-tuned Language Models
von: Raghuram, Jayaram, et al.
Veröffentlicht: (2024)

Infer Human's Intentions Before Following Natural Language Instructions
von: Wan, Yanming, et al.
Veröffentlicht: (2024)

Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models
von: Sun, Haoran, et al.
Veröffentlicht: (2024)

OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents
von: Wang, Zihao, et al.
Veröffentlicht: (2024)

Is In-Context Learning Sufficient for Instruction Following in LLMs?
von: Zhao, Hao, et al.
Veröffentlicht: (2024)

Revisiting Compositional Generalization Capability of Large Language Models Considering Instruction Following Ability
von: Sakai, Yusuke, et al.
Veröffentlicht: (2025)

SAIF: A Sparse Autoencoder Framework for Interpreting and Steering Instruction Following of Language Models
von: He, Zirui, et al.
Veröffentlicht: (2025)

Self-Review Framework for Enhancing Instruction Following Capability of LLM
von: Park, Sihyun
Veröffentlicht: (2025)

ReIFE: Re-evaluating Instruction-Following Evaluation
von: Liu, Yixin, et al.
Veröffentlicht: (2024)

Instruction-tuned Language Models are Better Knowledge Learners
von: Jiang, Zhengbao, et al.
Veröffentlicht: (2024)

Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models
von: Sun, Wangtao, et al.
Veröffentlicht: (2024)

Incentivizing Reasoning for Advanced Instruction-Following of Large Language Models
von: Qin, Yulei, et al.
Veröffentlicht: (2025)

Enhancing Low-Resource Language and Instruction Following Capabilities of Audio Language Models
von: Manakul, Potsawee, et al.
Veröffentlicht: (2024)

MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following
von: Lou, Renze, et al.
Veröffentlicht: (2023)

Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning
von: Zhi-Xuan, Tan, et al.
Veröffentlicht: (2024)

SPaR: Self-Play with Tree-Search Refinement to Improve Instruction-Following in Large Language Models
von: Cheng, Jiale, et al.
Veröffentlicht: (2024)

Instruction-Tuned, but Not More Verifiable Instruction-Following: A Cross-Task Diagnosis for LoRA Adapters
von: Zou, Junyi
Veröffentlicht: (2026)

Revisiting the Reliability of Language Models in Instruction-Following
von: Dong, Jianshuo, et al.
Veröffentlicht: (2025)

Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions
von: Cassano, Federico, et al.
Veröffentlicht: (2023)

Speech-FT: Merging Pre-trained And Fine-Tuned Speech Representation Models For Cross-Task Generalization
von: Lin, Tzu-Quan, et al.
Veröffentlicht: (2025)

Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning
von: Huang, Shih-Cheng, et al.
Veröffentlicht: (2022)

Replay Failures as Successes: Sample-Efficient Reinforcement Learning for Instruction Following
von: Zhang, Kongcheng, et al.
Veröffentlicht: (2025)

LIFEBench: Evaluating Length Instruction Following in Large Language Models
von: Zhang, Wei, et al.
Veröffentlicht: (2025)

Can Language Models Follow Multiple Turns of Entangled Instructions?
von: Han, Chi, et al.
Veröffentlicht: (2025)

The Instruction Gap: LLMs get lost in Following Instruction
von: Tripathi, Vishesh, et al.
Veröffentlicht: (2025)

On Calibration of Large Language Models: From Response To Capability
von: Yang, Sin-Han, et al.
Veröffentlicht: (2026)

CodeIF-Bench: Evaluating Instruction-Following Capabilities of Large Language Models in Interactive Code Generation
von: Wang, Peiding, et al.
Veröffentlicht: (2025)

Instruction Mining: Instruction Data Selection for Tuning Large Language Models
von: Cao, Yihan, et al.
Veröffentlicht: (2023)

Diverse and Fine-Grained Instruction-Following Ability Exploration with Synthetic Data
von: Gu, Zihui, et al.
Veröffentlicht: (2024)