Cover Image

Holdout-Loss-Based Data Selection for LLM Finetuning via In-Context Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Ling, Yang, Xianliang, Yu, Juwon, Cheonyoung, Park, Lee, Miran, Song, Lei, Bian, Jiang
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization Challenges
by: Yang, Xianliang, et al.
Published: (2025)

Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problems
by: Xia, Yifan, et al.
Published: (2024)

Learning to Select In-Context Demonstration Preferred by Large Language Model
by: Zhang, Zheng, et al.
Published: (2025)

Benchmark Inflation: Revealing LLM Performance Gaps Using Retro-Holdouts
by: Haimes, Jacob, et al.
Published: (2024)

FineScope : SAE-guided Data Selection Enables Domain Specific LLM Pruning and Finetuning
by: Bhattacharyya, Chaitali, et al.
Published: (2025)

BOTS: A Unified Framework for Bayesian Online Task Selection in LLM Reinforcement Finetuning
by: Shen, Qianli, et al.
Published: (2025)

In-Context Compositional Q-Learning for Offline Reinforcement Learning
by: Xu, Qiushui, et al.
Published: (2025)

Scalable In-Context Learning on Tabular Data via Retrieval-Augmented Large Language Models
by: Wen, Xumeng, et al.
Published: (2025)

Accurate Measures of Vaccination and Concerns of Vaccine Holdouts from Web Search Logs
by: Chang, Serina, et al.
Published: (2023)

Learning Dynamics of LLM Finetuning
by: Ren, Yi, et al.
Published: (2024)

Focus, Don't Prune: Identifying Instruction-Relevant Regions for Information-Rich Image Understanding
by: Kwon, Mincheol, et al.
Published: (2026)

Improving LLM Group Fairness on Tabular Data via In-Context Learning
by: Cherepanova, Valeriia, et al.
Published: (2024)

Lightweight Time Series Data Valuation on Time Series Foundation Models via In-Context Finetuning
by: Wu, Shunyu, et al.
Published: (2025)

Perturb a Model, Not an Image: Towards Robust Privacy Protection via Anti-Personalized Diffusion Models
by: Lee, Tae-Young, et al.
Published: (2025)

DARA: Few-shot Budget Allocation in Online Advertising via In-Context Decision Making with RL-Finetuned LLMs
by: Song, Mingxuan, et al.
Published: (2026)

Boosting LLM via Learning from Data Iteratively and Selectively
by: Jia, Qi, et al.
Published: (2024)

DICE: Dynamic In-Context Example Selection in LLM Agents via Efficient Knowledge Transfer
by: Wang, Ruoyu, et al.
Published: (2025)

Escaping the Context Bottleneck: Active Context Curation for LLM Agents via Reinforcement Learning
by: Li, Xiaozhe, et al.
Published: (2026)

Exploring Finetuned Audio-LLM on Heart Murmur Features
by: Florea, Adrian, et al.
Published: (2025)

Accelerate Scaling of LLM Finetuning via Quantifying the Coverage and Depth of Instruction Set
by: Wu, Chengwei, et al.
Published: (2025)

Learning Dynamics of VLM Finetuning
by: Zhang, Jusheng, et al.
Published: (2025)

From Patterns to Predictions: A Shapelet-Based Framework for Directional Forecasting in Noisy Financial Markets
by: Kim, Juwon, et al.
Published: (2025)

LLM-Inspired Pretrain-Then-Finetune for Small-Data, Large-Scale Optimization
by: Zhang, Zishi, et al.
Published: (2026)

SelectiveFinetuning: Enhancing Transfer Learning in Sleep Staging through Selective Domain Alignment
by: Zhao, Siyuan, et al.
Published: (2025)

Continual Learning via Sparse Memory Finetuning
by: Lin, Jessy, et al.
Published: (2025)

DyLLM: Efficient Diffusion LLM Inference via Saliency-based Token Selection and Partial Attention
by: Lee, Younjoo, et al.
Published: (2026)

LLM Data Selection and Utilization via Dynamic Bi-level Optimization
by: Yu, Yang, et al.
Published: (2025)

LLM-Based Offline Learning for Embodied Agents via Consistency-Guided Reward Ensemble
by: Lee, Yujeong, et al.
Published: (2024)

MISS: A Generative Pretraining and Finetuning Approach for Med-VQA
by: Chen, Jiawei, et al.
Published: (2024)

Latent Factorization of Tensors with Threshold Distance Weighted Loss for Traffic Data Estimation
by: Yang, Lei
Published: (2025)

StreamingDialogue: Prolonged Dialogue Learning via Long Context Compression with Minimal Losses
by: Li, Jia-Nan, et al.
Published: (2024)

LLM Unlearning via Loss Adjustment with Only Forget Data
by: Wang, Yaxuan, et al.
Published: (2024)

Demonstration Selection for In-Context Learning via Reinforcement Learning
by: Wang, Xubin, et al.
Published: (2024)

KeyDiff: Key Similarity-Based KV Cache Eviction for Long-Context LLM Inference in Resource-Constrained Environments
by: Park, Junyoung, et al.
Published: (2025)

Shaking to Reveal: Perturbation-Based Detection of LLM Hallucinations
by: Luo, Jinyuan, et al.
Published: (2025)

Generative Unlearning for Any Identity
by: Seo, Juwon, et al.
Published: (2024)

PRISM: Breaking the O(n) Memory Wall in Long-Context LLM Inference via O(1) Photonic Block Selection
by: Park, Hyoseok, et al.
Published: (2026)

Efficient LLM Collaboration via Planning
by: Lee, Byeongchan, et al.
Published: (2025)

CHESS: Context-aware Hierarchical Efficient Semantic Selection for Long-Context LLM Inference
by: Fei, Chao, et al.
Published: (2026)

Representation Finetuning for Continual Learning
by: Luo, Haihua, et al.
Published: (2026)