Copertina

Influence-Preserving Proxies for Gradient-Based Data Selection in LLM Fine-tuning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chen, Sirui, Qi, Yunzhe, Ai, Mengting, Sun, Yifan, Qiu, Ruizhong, Zou, Jiaru, He, Jingrui
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuning
di: Zou, Jiaru, et al.
Pubblicazione: (2025)

AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning
di: Zou, Jiaru, et al.
Pubblicazione: (2025)

MLP Fusion: Towards Efficient Fine-tuning of Dense and Mixture-of-Experts Language Models
di: Ai, Mengting, et al.
Pubblicazione: (2023)

NIRVANA: Structured pruning reimagined for large language models compression
di: Ai, Mengting, et al.
Pubblicazione: (2025)

Heterogeneous Scientific Foundation Model Collaboration
di: Li, Zihao, et al.
Pubblicazione: (2026)

EvoSelect: Data-Efficient LLM Evolution for Targeted Task Adaptation
di: Li, Ting-Wei, et al.
Pubblicazione: (2026)

LLM-Forest: Ensemble Learning of LLMs with Graph-Augmented Prompts for Data Imputation
di: He, Xinrui, et al.
Pubblicazione: (2024)

PageRank Bandits for Link Prediction
di: Ban, Yikun, et al.
Pubblicazione: (2024)

Gradient Compressed Sensing: A Query-Efficient Gradient Estimator for High-Dimensional Zeroth-Order Optimization
di: Qiu, Ruizhong, et al.
Pubblicazione: (2024)

RAG over Tables: Hierarchical Memory Index, Multi-Stage Retrieval, and Benchmarking
di: Zou, Jiaru, et al.
Pubblicazione: (2025)

Improving Data Efficiency for LLM Reinforcement Fine-tuning Through Difficulty-targeted Online Data Selection and Rollout Replay
di: Sun, Yifan, et al.
Pubblicazione: (2025)

APEX$^2$: Adaptive and Extreme Summarization for Personalized Knowledge Graphs
di: Li, Zihao, et al.
Pubblicazione: (2024)

Saffron-1: Safety Inference Scaling
di: Qiu, Ruizhong, et al.
Pubblicazione: (2025)

Utility-Diversity Aware Online Batch Selection for LLM Supervised Fine-tuning
di: Zou, Heming, et al.
Pubblicazione: (2025)

Graph Data Selection for Domain Adaptation: A Model-Free Approach
di: Li, Ting-Wei, et al.
Pubblicazione: (2025)

Fair Anomaly Detection For Imbalanced Groups
di: Wu, Ziwei, et al.
Pubblicazione: (2024)

Latte: Collaborative Test-Time Adaptation of Vision-Language Models in Federated Learning
di: Bao, Wenxuan, et al.
Pubblicazione: (2025)

Recursive Multi-Agent Systems
di: Yang, Xiyuan, et al.
Pubblicazione: (2026)

Meta Clustering of Neural Bandits
di: Ban, Yikun, et al.
Pubblicazione: (2024)

PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning
di: Zou, Jiaru, et al.
Pubblicazione: (2024)

Latent Collaboration in Multi-Agent Systems
di: Zou, Jiaru, et al.
Pubblicazione: (2025)

SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection
di: Shen, Han, et al.
Pubblicazione: (2024)

Proxy-FDA: Proxy-based Feature Distribution Alignment for Fine-tuning Vision Foundation Models without Forgetting
di: Huang, Chen, et al.
Pubblicazione: (2025)

PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning
di: Wang, Qibin, et al.
Pubblicazione: (2024)

Memento: Fine-tuning LLM Agents without Fine-tuning LLMs
di: Zhou, Huichi, et al.
Pubblicazione: (2025)

Filter-then-Weight: Online Data Selection and Reweighting for LLM Fine-Tuning
di: Wang, Fangxin, et al.
Pubblicazione: (2026)

PowerGrow: Feasible Co-Growth of Structures and Dynamics for Power Grid Synthesis
di: He, Xinyu, et al.
Pubblicazione: (2025)

CooperLLM: Cloud-Edge-End Cooperative Federated Fine-tuning for LLMs via ZOO-based Gradient Correction
di: Sun, He, et al.
Pubblicazione: (2026)

ClusterUCB: Efficient Gradient-Based Data Selection for Targeted Fine-Tuning of LLMs
di: Wang, Zige, et al.
Pubblicazione: (2025)

ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration
di: Ai, Mengting, et al.
Pubblicazione: (2025)

Prune as You Generate: Online Rollout Pruning for Faster and Better RLVR
di: Xu, Haobo, et al.
Pubblicazione: (2026)

PRISM: Preference-Aware Influence Function Based Data Selection Method for Efficient Fine-Tuning
di: Lin, Qihao, et al.
Pubblicazione: (2026)

A General Framework to Enhance Fine-tuning-based LLM Unlearning
di: Ren, Jie, et al.
Pubblicazione: (2025)

Towards Fast LLM Fine-tuning through Zeroth-Order Optimization with Projected Gradient-Aligned Perturbations
di: Mi, Zhendong, et al.
Pubblicazione: (2025)

The Blessing of Dimensionality in LLM Fine-tuning: A Variance-Curvature Perspective
di: Liang, Qiyao, et al.
Pubblicazione: (2026)

DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models
di: Kwon, Yongchan, et al.
Pubblicazione: (2023)

FedMomentum: Preserving LoRA Training Momentum in Federated Fine-Tuning
di: Yan, Peishen, et al.
Pubblicazione: (2026)

Analyzing the Effect of Noise in LLM Fine-tuning
di: Li, Lingfang, et al.
Pubblicazione: (2026)

Breaking Silos: Adaptive Model Fusion Unlocks Better Time Series Forecasting
di: Liu, Zhining, et al.
Pubblicazione: (2025)

BoostLLM: Boosting-inspired LLM Fine-tuning for Few-shot Tabular Classification
di: Wang, Yi-Siang, et al.
Pubblicazione: (2026)