Imagen de Portada

InstructDiff: Domain-Adaptive Data Selection via Differential Entropy for Efficient LLM Fine-Tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Su, Junyou, Zhu, He, Luo, Xiao, Zhang, Liyu, Zhou, Hong-Yu, Chen, Yun, Li, Peng, Liu, Yang, Chen, Guanhua
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Anchored Supervised Fine-Tuning
por: Zhu, He, et al.
Publicado: (2025)

Enhancing Large Language Model Reasoning via Selective Critical Token Fine-Tuning
por: Ruan, Zhiwen, et al.
Publicado: (2025)

PlanGPT-VL: Enhancing Urban Planning with Domain-Specific Vision-Language Models
por: Zhu, He, et al.
Publicado: (2025)

TAG-INSTRUCT: Controlled Instruction Complexity Enhancement through Structure-based Augmentation
por: Zhu, He, et al.
Publicado: (2025)

FANNO: Augmenting High-Quality Instruction Data with Open-Sourced LLMs Only
por: Zhu, He, et al.
Publicado: (2024)

GIFT: Guided Fine-Tuning and Transfer for Enhancing Instruction-Tuned Language Models
por: Ruan, Zhiwen, et al.
Publicado: (2026)

Token Cleaning: Fine-Grained Data Selection for LLM Supervised Fine-Tuning
por: Pang, Jinlong, et al.
Publicado: (2025)

Filter-then-Weight: Online Data Selection and Reweighting for LLM Fine-Tuning
por: Wang, Fangxin, et al.
Publicado: (2026)

Selection of LLM Fine-Tuning Data based on Orthogonal Rules
por: Li, Xiaomin, et al.
Publicado: (2024)

Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
por: Li, Ming, et al.
Publicado: (2024)

LEAD: Iterative Data Selection for Efficient LLM Instruction Tuning
por: Lin, Xiaotian, et al.
Publicado: (2025)

MSSR: Memory-Aware Adaptive Replay for Continual LLM Fine-Tuning
por: Lu, Yiyang, et al.
Publicado: (2026)

To Diff or Not to Diff? Structure-Aware and Adaptive Output Formats for Efficient LLM-based Code Editing
por: Cheng, Wei, et al.
Publicado: (2026)

Representation-Guided Parameter-Efficient LLM Unlearning
por: Xiao, Zeguan, et al.
Publicado: (2026)

DP-SelFT: Differentially Private Selective Fine-Tuning for Large Language Models
por: Sha, Haichao, et al.
Publicado: (2026)

Learning to Instruct for Visual Instruction Tuning
por: Zhou, Zhihan, et al.
Publicado: (2025)

MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning
por: Wang, Hanqing, et al.
Publicado: (2024)

Adaptive Layer Selection for Efficient Vision Transformer Fine-Tuning
por: Devoto, Alessio, et al.
Publicado: (2024)

DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Data
por: Zhu, Jingyuan, et al.
Publicado: (2023)

ConInstruct: Evaluating Large Language Models on Conflict Detection and Resolution in Instructions
por: He, Xingwei, et al.
Publicado: (2025)

Parameter-Efficient Subspace Optimization for LLM Fine-Tuning
por: Lou, Yuchen, et al.
Publicado: (2025)

Quantum-Enhanced LLM Efficient Fine Tuning
por: Kong, Xiaofei, et al.
Publicado: (2025)

One Algorithm, Two Goals: Dual Scoring for Parameter and Data Selection in LLM Fine-Tuning
por: Chen, Xinrui, et al.
Publicado: (2026)

S2FT: Parameter-Efficient Fine-Tuning in Sparse Spectrum Domain
por: Zhang, Baoquan, et al.
Publicado: (2026)

Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning
por: Wang, Shaobo, et al.
Publicado: (2025)

CurvZO: Adaptive Curvature-Guided Sparse Zeroth-Order Optimization for Efficient LLM Fine-Tuning
por: Wang, Shuo, et al.
Publicado: (2026)

The Long-Term Effects of Data Selection in LLM Fine-Tuning
por: Yang, Yuxin, et al.
Publicado: (2026)

Synergy over Discrepancy: A Partition-Based Approach to Multi-Domain LLM Fine-Tuning
por: Ye, Hua, et al.
Publicado: (2025)

SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation
por: Li, Yixia, et al.
Publicado: (2024)

ArgInstruct: Specialized Instruction Fine-Tuning for Computational Argumentation
por: Stahl, Maja, et al.
Publicado: (2025)

LayAlign: Enhancing Multilingual Reasoning in Large Language Models via Layer-Wise Adaptive Fusion and Alignment Strategy
por: Ruan, Zhiwen, et al.
Publicado: (2025)

DiffTune: Auto-Tuning through Auto-Differentiation
por: Cheng, Sheng, et al.
Publicado: (2022)

Adaptive Ensembles of Fine-Tuned Transformers for LLM-Generated Text Detection
por: Lai, Zhixin, et al.
Publicado: (2024)

Importance-Aware Data Selection for Efficient LLM Instruction Tuning
por: Jiang, Tingyu, et al.
Publicado: (2025)

Differentiation-Based Extraction of Proprietary Data from Fine-Tuned LLMs
por: Li, Zongjie, et al.
Publicado: (2025)

PACIT: Unlocking the Power of Examples for Better In-Context Instruction Tuning
por: Xue, Tianci, et al.
Publicado: (2023)

Diff-Instruct++: Training One-step Text-to-image Generator Model to Align with Human Preferences
por: Luo, Weijian
Publicado: (2024)

Security Vulnerability Detection with Multitask Self-Instructed Fine-Tuning of Large Language Models
por: Yang, Aidan Z. H., et al.
Publicado: (2024)

PRISM: Preference-Aware Influence Function Based Data Selection Method for Efficient Fine-Tuning
por: Lin, Qihao, et al.
Publicado: (2026)

Memory-Efficient Structured Backpropagation for On-Device LLM Fine-Tuning
por: Park, Juneyoung, et al.
Publicado: (2026)