Image de couverture de livre

Reinforcement Learning Fine-Tunes a Sparse Subnetwork in Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Balashov, Andrii
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Scaling Sparse Fine-Tuning to Large Language Models
par: Ansell, Alan, et autres
Publié: (2024)

On the Entropy Dynamics in Reinforcement Fine-Tuning of Large Language Models
par: Wang, Shumin, et autres
Publié: (2026)

Robust Reinforcement Learning from Human Feedback for Large Language Models Fine-Tuning
par: Ye, Kai, et autres
Publié: (2025)

The Multiple Ticket Hypothesis: Random Sparse Subnetworks Suffice for RLVR
par: Adewuyi, Israel, et autres
Publié: (2026)

Linearization Explains Fine-Tuning in Large Language Models
par: Afzal, Zahra Rahimi, et autres
Publié: (2026)

Task-specific Subnetwork Discovery in Reinforcement Learning for Autonomous Underwater Navigation
par: Liu, Yi-Ling, et autres
Publié: (2026)

Unlock the Correlation between Supervised Fine-Tuning and Reinforcement Learning in Training Code Large Language Models
par: Chen, Jie, et autres
Publié: (2024)

Preserving Diversity in Supervised Fine-Tuning of Large Language Models
par: Li, Ziniu, et autres
Publié: (2024)

Model Parallelism With Subnetwork Data Parallelism
par: Singh, Vaibhav, et autres
Publié: (2025)

Enhancing Reinforcement Learning Fine-Tuning with an Online Refiner
par: Ma, Hao, et autres
Publié: (2026)

Discovering Knowledge-Critical Subnetworks in Pretrained Language Models
par: Bayazit, Deniz, et autres
Publié: (2023)

Refine-POI: Reinforcement Fine-Tuned Large Language Models for Next Point-of-Interest Recommendation
par: Li, Peibo, et autres
Publié: (2025)

SSFL: Discovering Sparse Unified Subnetworks at Initialization for Efficient Federated Learning
par: Ohib, Riyasat, et autres
Publié: (2024)

Memory Constrained Dynamic Subnetwork Update for Transfer Learning
par: Quélennec, Aël, et autres
Publié: (2025)

Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models
par: Wang, Zihan, et autres
Publié: (2024)

Nested-ReFT: Efficient Reinforcement Learning for Large Language Model Fine-Tuning via Off-Policy Rollouts
par: Heuillet, Maxime, et autres
Publié: (2025)

Large Language Models for Sequential Decision-Making: Improving In-Context Learning via Supervised Fine-Tuning
par: Zhang, Minmin, et autres
Publié: (2026)

Instilling Inductive Biases with Subnetworks
par: Zhang, Enyan, et autres
Publié: (2023)

SFT-GO: Supervised Fine-Tuning with Group Optimization for Large Language Models
par: Kim, Gyuhak, et autres
Publié: (2025)

QuZO: Quantized Zeroth-Order Fine-Tuning for Large Language Models
par: Zhou, Jiajun, et autres
Publié: (2025)

Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models
par: Fang, Zihan, et autres
Publié: (2024)

Boosting Large Language Models with Mask Fine-Tuning
par: Zhang, Mingyuan, et autres
Publié: (2025)

Fine-Tuning Diffusion Models for Molecular Generation via Reinforcement Learning and Fast Sampling
par: Lin, Guang, et autres
Publié: (2026)

Supervised Fine Tuning on Curated Data is Reinforcement Learning (and can be improved)
par: Qin, Chongli, et autres
Publié: (2025)

A Bayesian Hybrid Parameter-Efficient Fine-Tuning Method for Large Language Models
par: Chai, Yidong, et autres
Publié: (2025)

The Effectiveness of Approximate Regularized Replay for Efficient Supervised Fine-Tuning of Large Language Models
par: Riemer, Matthew, et autres
Publié: (2025)

FedKRSO: Communication and Memory Efficient Federated Fine-Tuning of Large Language Models
par: Yang, Guohao, et autres
Publié: (2026)

Sparsity-Aware Low-Rank Representation for Efficient Fine-Tuning of Large Language Models
par: Zhang, Longteng, et autres
Publié: (2026)

Understanding and Guiding Layer Placement in Parameter-Efficient Fine-Tuning of Large Language Models
par: Xu, Yichen, et autres
Publié: (2026)

IRIS: Interpolative Rényi Iterative Self-play for Large Language Model Fine-Tuning
par: Liao, Wenjie, et autres
Publié: (2026)

Supervised Fine-Tuning as Inverse Reinforcement Learning
par: Sun, Hao
Publié: (2024)

DLPO: Diffusion Model Loss-Guided Reinforcement Learning for Fine-Tuning Text-to-Speech Diffusion Models
par: Chen, Jingyi, et autres
Publié: (2024)

Improving Large Language Models with Concept-Aware Fine-Tuning
par: Chen, Michael K., et autres
Publié: (2025)

Crafting Efficient Fine-Tuning Strategies for Large Language Models
par: Oliver, Michael, et autres
Publié: (2024)

Fine-Tuning Language Models with Reward Learning on Policy
par: Lang, Hao, et autres
Publié: (2024)

Learning What Reinforcement Learning Can't: Interleaved Online Fine-Tuning for Hardest Questions
par: Ma, Lu, et autres
Publié: (2025)

Sparse is Enough in Fine-tuning Pre-trained Large Language Models
par: Song, Weixi, et autres
Publié: (2023)

FLAME: Towards Federated Fine-Tuning Large Language Models Through Adaptive SMoE
par: Le, Khiem, et autres
Publié: (2025)

RoSTE: An Efficient Quantization-Aware Supervised Fine-Tuning Approach for Large Language Models
par: Wei, Quan, et autres
Publié: (2025)

Efficient Inference Using Large Language Models with Limited Human Data: Fine-Tuning then Rectification
par: Wang, Lei, et autres
Publié: (2025)