Cover Image

Beyond Similarity: A Gradient-based Graph Method for Instruction Tuning Data Selection

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhao, Yang, Du, Li, Ding, Xiao, Ouyang, Yangou, Wang, Hepeng, Xiong, Kai, Gao, Jinglong, Sun, Zhouhao, Xu, Dongliang, Qing, Yang, Li, Dongchen, Qin, Bing, Liu, Ting
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Consolidation or Adaptation? PRISM: Disentangling SFT and RL Data via Gradient Concentration
by: Zhao, Yang, et al.
Published: (2026)

MAESTRO: Meta-learning Adaptive Estimation of Scalarization Trade-offs for Reward Optimization
by: Zhao, Yang, et al.
Published: (2026)

UFO-RL: Uncertainty-Focused Optimization for Efficient Reinforcement Learning Data Selection
by: Zhao, Yang, et al.
Published: (2025)

Towards Generalizable and Faithful Logic Reasoning over Natural Language via Resolution Refutation
by: Sun, Zhouhao, et al.
Published: (2024)

Deciphering the Impact of Pretraining Data on Large Language Models through Machine Unlearning
by: Zhao, Yang, et al.
Published: (2024)

Supervised Fine-Tuning Achieve Rapid Task Adaption Via Alternating Attention Head Activation Patterns
by: Zhao, Yang, et al.
Published: (2024)

Self-Evolving GPT: A Lifelong Autonomous Experiential Learner
by: Gao, Jinglong, et al.
Published: (2024)

Self-Route: Automatic Mode Switching via Capability Estimation for Efficient Reasoning
by: He, Yang, et al.
Published: (2025)

DeepTool: Scaling Interleaved Deliberation in Tool-Integrated Reasoning via Process-Supervised Reinforcement Learning
by: He, Yang, et al.
Published: (2026)

Meaningful Learning: Enhancing Abstract Reasoning in Large Language Models via Generic Fact Guidance
by: Xiong, Kai, et al.
Published: (2024)

Large Language Models Are Still Misled by Simple Bias Ensembles
by: Sun, Zhouhao, et al.
Published: (2025)

Causal-Guided Active Learning for Debiasing Large Language Models
by: Du, Li, et al.
Published: (2024)

Information Gain-Guided Causal Intervention for Autonomous Debiasing Large Language Models
by: Sun, Zhouhao, et al.
Published: (2025)

Com$^2$: A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models
by: Xiong, Kai, et al.
Published: (2025)

CrossICL: Cross-Task In-Context Learning via Unsupervised Demonstration Transfer
by: Gao, Jinglong, et al.
Published: (2025)

Enhancing Complex Causality Extraction via Improved Subtask Interaction and Knowledge Fusion
by: Gao, Jinglong, et al.
Published: (2024)

Beyond Fixed Length: Bucket Pre-training is All You Need
by: Yang, Qing, et al.
Published: (2024)

GR-Ben: A General Reasoning Benchmark for Evaluating Process Reward Models
by: Sun, Zhouhao, et al.
Published: (2026)

ExpeTrans: LLMs Are Experiential Transfer Learners
by: Gao, Jinglong, et al.
Published: (2025)

TAGCOS: Task-agnostic Gradient Clustered Coreset Selection for Instruction Tuning Data
by: Zhang, Jipeng, et al.
Published: (2024)

Toward Secure Tuning: Mitigating Security Risks from Instruction Fine-Tuning
by: Du, Yanrui, et al.
Published: (2024)

Diagnosing and Remedying Knowledge Deficiencies in LLMs via Label-free Curricular Meaningful Learning
by: Xiong, Kai, et al.
Published: (2024)

Know the Unknown: An Uncertainty-Sensitive Method for LLM Instruction Tuning
by: Li, Jiaqi, et al.
Published: (2024)

On shape optimization for fourth order Steklov eigenvalue problems
by: Xiong, Changwei, et al.
Published: (2024)

Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate
by: Xiong, Kai, et al.
Published: (2023)

Star-Agents: Automatic Data Optimization with LLM Agents for Instruction Tuning
by: Zhou, Hang, et al.
Published: (2024)

$C^1$-robust homoclinic tangencies
by: Li, Dongchen
Published: (2024)

Blender-producing mechanisms and a dichotomy for local dynamics for heterodimensional cycles
by: Li, Dongchen
Published: (2024)

Towards Robust Graph Structural Learning Beyond Homophily via Preserving Neighbor Similarity
by: Zhu, Yulin, et al.
Published: (2024)

Select2Reason: Efficient Instruction-Tuning Data Selection for Long-CoT Reasoning
by: Yang, Cehao, et al.
Published: (2025)

How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers
by: Lu, Xin, et al.
Published: (2024)

Similarity-based Neighbor Selection for Graph LLMs
by: Li, Rui, et al.
Published: (2024)

ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks
by: Xiong, Kai, et al.
Published: (2022)

Uncertainty-Aware Gradient Signal-to-Noise Data Selection for Instruction Tuning
by: Yuan, Zhihang, et al.
Published: (2026)

Data Diversity Matters for Robust Instruction Tuning
by: Bukharin, Alexander, et al.
Published: (2023)

MIG: Automatic Data Selection for Instruction Tuning by Maximizing Information Gain in Semantic Space
by: Chen, Yicheng, et al.
Published: (2025)

Science in Movements
by: Jia, Hepeng
Published: (2021)

Text Difficulty Study: Do machines behave the same as humans regarding text difficulty?
by: Chen, Bowen, et al.
Published: (2022)

Multimodal Continual Instruction Tuning with Dynamic Gradient Guidance
by: Li, Songze, et al.
Published: (2025)

Memory-Efficient LLM Training by Various-Grained Low-Rank Projection of Gradients
by: Wang, Yezhen, et al.
Published: (2025)