LENSLLM: Unveiling Fine-Tuning Dynamics for LLM Selection
Fuente:
arXiv
Guardado en:
| Autores principales: | Zeng, Xinyue, Wang, Haohui, Lin, Junhong, Wu, Jun, Cody, Tyler, Zhou, Dawei |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Data Value in the Age of Scaling: Understanding LLM Scaling Dynamics Under Real-Synthetic Data Mixtures
por: Wang, Haohui, et al.
Publicado: (2025)
por: Wang, Haohui, et al.
Publicado: (2025)
HalluGuard: Demystifying Data-Driven and Reasoning-Driven Hallucinations in LLMs
por: Zeng, Xinyue, et al.
Publicado: (2026)
por: Zeng, Xinyue, et al.
Publicado: (2026)
Alignment Dynamics in LLM Fine-Tuning
por: Huang, Yuhan, et al.
Publicado: (2026)
por: Huang, Yuhan, et al.
Publicado: (2026)
HeroFilter: Adaptive Spectral Graph Filter for Varying Heterophilic Relations
por: Zhang, Shuaicheng, et al.
Publicado: (2025)
por: Zhang, Shuaicheng, et al.
Publicado: (2025)
Mitigating Training Imbalance in LLM Fine-Tuning via Selective Parameter Merging
por: Ju, Yiming, et al.
Publicado: (2024)
por: Ju, Yiming, et al.
Publicado: (2024)
FedSelect: Personalized Federated Learning with Customized Selection of Parameters for Fine-Tuning
por: Tamirisa, Rishub, et al.
Publicado: (2024)
por: Tamirisa, Rishub, et al.
Publicado: (2024)
RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation
por: Liu, Jun, et al.
Publicado: (2025)
por: Liu, Jun, et al.
Publicado: (2025)
Filter-then-Weight: Online Data Selection and Reweighting for LLM Fine-Tuning
por: Wang, Fangxin, et al.
Publicado: (2026)
por: Wang, Fangxin, et al.
Publicado: (2026)
Silent Inconsistency in Data-Parallel Full Fine-Tuning: Diagnosing Worker-Level Optimization Misalignment
por: Li, Hong, et al.
Publicado: (2026)
por: Li, Hong, et al.
Publicado: (2026)
Internalizing Curriculum Judgment for LLM Reinforcement Fine-Tuning
por: Zheng, Han, et al.
Publicado: (2026)
por: Zheng, Han, et al.
Publicado: (2026)
FedSelect: Customized Selection of Parameters for Fine-Tuning during Personalized Federated Learning
por: Tamirisa, Rishub, et al.
Publicado: (2023)
por: Tamirisa, Rishub, et al.
Publicado: (2023)
Selection of LLM Fine-Tuning Data based on Orthogonal Rules
por: Li, Xiaomin, et al.
Publicado: (2024)
por: Li, Xiaomin, et al.
Publicado: (2024)
GENUINE: Graph Enhanced Multi-level Uncertainty Estimation for Large Language Models
por: Wang, Tuo, et al.
Publicado: (2025)
por: Wang, Tuo, et al.
Publicado: (2025)
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning
por: Chen, Yupeng, et al.
Publicado: (2024)
por: Chen, Yupeng, et al.
Publicado: (2024)
Data Difficulty and the Generalization--Extrapolation Tradeoff in LLM Fine-Tuning
por: Liu, Siyuan, et al.
Publicado: (2026)
por: Liu, Siyuan, et al.
Publicado: (2026)
Implicit Federated In-context Learning For Task-Specific LLM Fine-Tuning
por: Li, Dongcheng, et al.
Publicado: (2025)
por: Li, Dongcheng, et al.
Publicado: (2025)
Stabilizing LLM Supervised Fine-Tuning via Explicit Distributional Control
por: Wang, Xinyu, et al.
Publicado: (2026)
por: Wang, Xinyu, et al.
Publicado: (2026)
LEAP: Unlocking dLLM Parallelism via Lookahead Early-Convergence Token Detection
por: Zhang, Haohui, et al.
Publicado: (2026)
por: Zhang, Haohui, et al.
Publicado: (2026)
DipLLM: Fine-Tuning LLM for Strategic Decision-making in Diplomacy
por: Xu, Kaixuan, et al.
Publicado: (2025)
por: Xu, Kaixuan, et al.
Publicado: (2025)
Overcoming Forgetting in LLM Fine-Tuning with Evolution Strategies
por: Schweighofer, Kajetan, et al.
Publicado: (2026)
por: Schweighofer, Kajetan, et al.
Publicado: (2026)
Goal-Conditioned Supervised Learning for LLM Fine-Tuning
por: Li, Shijun, et al.
Publicado: (2026)
por: Li, Shijun, et al.
Publicado: (2026)
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
por: Li, Ming, et al.
Publicado: (2024)
por: Li, Ming, et al.
Publicado: (2024)
FT-Dojo: Towards Autonomous LLM Fine-Tuning with Language Agents
por: Li, Qizheng, et al.
Publicado: (2026)
por: Li, Qizheng, et al.
Publicado: (2026)
GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning
por: Zhou, Sifan, et al.
Publicado: (2025)
por: Zhou, Sifan, et al.
Publicado: (2025)
Aligning LLMs with Biomedical Knowledge using Balanced Fine-Tuning
por: Tang, Zhenchao, et al.
Publicado: (2025)
por: Tang, Zhenchao, et al.
Publicado: (2025)
SafeTuneBed: A Toolkit for Benchmarking LLM Safety Alignment in Fine-Tuning
por: Hossain, Saad, et al.
Publicado: (2025)
por: Hossain, Saad, et al.
Publicado: (2025)
On the Entropy Dynamics in Reinforcement Fine-Tuning of Large Language Models
por: Wang, Shumin, et al.
Publicado: (2026)
por: Wang, Shumin, et al.
Publicado: (2026)
MallowsPO: Fine-Tune Your LLM with Preference Dispersions
por: Chen, Haoxian, et al.
Publicado: (2024)
por: Chen, Haoxian, et al.
Publicado: (2024)
Mildly Conservative Regularized Evaluation for Offline Reinforcement Learning
por: Chen, Haohui, et al.
Publicado: (2025)
por: Chen, Haohui, et al.
Publicado: (2025)
A Bayesian Hybrid Parameter-Efficient Fine-Tuning Method for Large Language Models
por: Chai, Yidong, et al.
Publicado: (2025)
por: Chai, Yidong, et al.
Publicado: (2025)
Study of Training Dynamics for Memory-Constrained Fine-Tuning
por: Quélennec, Aël, et al.
Publicado: (2025)
por: Quélennec, Aël, et al.
Publicado: (2025)
ConstellationNet: Reinventing Spatial Clustering through GNNs
por: Gao, Aidan, et al.
Publicado: (2025)
por: Gao, Aidan, et al.
Publicado: (2025)
Balancing Fidelity and Plasticity: Aligning Mixed-Precision Fine-Tuning with Linguistic Hierarchies
por: Zhou, Changhai, et al.
Publicado: (2025)
por: Zhou, Changhai, et al.
Publicado: (2025)
LEAD: Iterative Data Selection for Efficient LLM Instruction Tuning
por: Lin, Xiaotian, et al.
Publicado: (2025)
por: Lin, Xiaotian, et al.
Publicado: (2025)
Fine-Tuning ChemBERTa for Predicting Inhibitory Activity Against TDP1 Using Deep Learning
por: Zeng, Baichuan
Publicado: (2025)
por: Zeng, Baichuan
Publicado: (2025)
Representation Without Reward: A JEPA Audit for LLM Fine-Tuning
por: Sengupta, Biswa
Publicado: (2026)
por: Sengupta, Biswa
Publicado: (2026)
Adaptive Ensembles of Fine-Tuned Transformers for LLM-Generated Text Detection
por: Lai, Zhixin, et al.
Publicado: (2024)
por: Lai, Zhixin, et al.
Publicado: (2024)
iTool: Reinforced Fine-Tuning with Dynamic Deficiency Calibration for Advanced Tool Use
por: Zeng, Yirong, et al.
Publicado: (2025)
por: Zeng, Yirong, et al.
Publicado: (2025)
Zeroth-Order Fine-Tuning of LLMs in Random Subspaces
por: Yu, Ziming, et al.
Publicado: (2024)
por: Yu, Ziming, et al.
Publicado: (2024)
SplitFrozen: Split Learning with Device-side Model Frozen for Fine-Tuning LLM on Heterogeneous Resource-Constrained Devices
por: Ma, Jian, et al.
Publicado: (2025)
por: Ma, Jian, et al.
Publicado: (2025)
Ejemplares similares
-
Data Value in the Age of Scaling: Understanding LLM Scaling Dynamics Under Real-Synthetic Data Mixtures
por: Wang, Haohui, et al.
Publicado: (2025) -
HalluGuard: Demystifying Data-Driven and Reasoning-Driven Hallucinations in LLMs
por: Zeng, Xinyue, et al.
Publicado: (2026) -
Alignment Dynamics in LLM Fine-Tuning
por: Huang, Yuhan, et al.
Publicado: (2026) -
HeroFilter: Adaptive Spectral Graph Filter for Varying Heterophilic Relations
por: Zhang, Shuaicheng, et al.
Publicado: (2025) -
Mitigating Training Imbalance in LLM Fine-Tuning via Selective Parameter Merging
por: Ju, Yiming, et al.
Publicado: (2024)