Cover Image

ScheduleFree+: Scaling Learning-Rate-Free & Schedule-Free Learning to Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Defazio, Aaron
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Optimal Linear Decay Learning Rate Schedules and Further Refinements
by: Defazio, Aaron, et al.
Published: (2023)

Prodigy: An Expeditiously Adaptive Parameter-Free Learner
by: Mishchenko, Konstantin, et al.
Published: (2023)

Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging
by: Meterez, Alexandru, et al.
Published: (2026)

Analysis of Schedule-Free Nonconvex Optimization
by: Brown, Connor
Published: (2025)

The Road Less Scheduled
by: Defazio, Aaron, et al.
Published: (2024)

Why Gradients Rapidly Increase Near the End of Training
by: Defazio, Aaron
Published: (2025)

Anytime Training with Schedule-Free Spectral Optimization
by: Apte, Anuj, et al.
Published: (2026)

Through the River: Understanding the Benefit of Schedule-Free Methods for Language Model Training
by: Song, Minhak, et al.
Published: (2025)

Connections between Schedule-Free Optimizers, AdEMAMix, and Accelerated SGD Variants
by: Morwani, Depen, et al.
Published: (2025)

Cyclical Log Annealing as a Learning Rate Scheduler
by: Naveen, Philip
Published: (2024)

Isotuning With Applications To Scale-Free Online Learning
by: Orseau, Laurent, et al.
Published: (2021)

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler
by: Shen, Yikang, et al.
Published: (2024)

Learning Rate-Free Reinforcement Learning: A Case for Model Selection with Non-Stationary Objectives
by: Afshar, Aida, et al.
Published: (2024)

GILT: An LLM-Free, Tuning-Free Graph Foundational Model for In-Context Learning
by: Ma, Weishuo, et al.
Published: (2025)

Investigating the Potential of Using Large Language Models for Scheduling
by: Jobson, Deddy, et al.
Published: (2024)

Heterogeneous Learning Rate Scheduling for Neural Architecture Search on Long-Tailed Datasets
by: Tang, Chenxia
Published: (2024)

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler
by: Dremov, Aleksandr, et al.
Published: (2025)

Training-Free Geospatial Place Representation Learning from Large-Scale Point-of-Interest Graph Data
by: Hashemi, Mohammad, et al.
Published: (2025)

Interpreting Emergent Planning in Model-Free Reinforcement Learning
by: Bush, Thomas, et al.
Published: (2025)

Towards General-Purpose Model-Free Reinforcement Learning
by: Fujimoto, Scott, et al.
Published: (2025)

SwiftPrune: Hessian-Free Weight Pruning for Large Language Models
by: Kang, Yuhan, et al.
Published: (2025)

Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling
by: Meterez, Alexandru, et al.
Published: (2025)

Label-Free Reinforcement Learning via Cross-Model Entropy
by: Gorbett, Matt, et al.
Published: (2026)

Model-Free Robust Reinforcement Learning with Sample Complexity Analysis
by: Wang, Yudan, et al.
Published: (2024)

Smoothie: Label Free Language Model Routing
by: Guha, Neel, et al.
Published: (2024)

Learning From Scenarios for Stochastic Repairable Scheduling
by: Houten, Kim van den, et al.
Published: (2023)

ReLU's Revival: On the Entropic Overload in Normalization-Free Large Language Models
by: Jha, Nandan Kumar, et al.
Published: (2024)

Offline Reinforcement Learning for Learning to Dispatch for Job Shop Scheduling
by: van Remmerden, Jesse, et al.
Published: (2024)

Source-Free Cross-Domain Continual Learning
by: Furqon, Muhammad Tanzil, et al.
Published: (2025)

Regret-Free Reinforcement Learning for LTL Specifications
by: Majumdar, Rupak, et al.
Published: (2024)

Observation-Free Attacks on Online Learning to Rank
by: Chattopadhyay, Sameep, et al.
Published: (2025)

HO-SFL: Hybrid-Order Split Federated Learning with Backprop-Free Clients and Dimension-Free Aggregation
by: Chen, Qiyuan, et al.
Published: (2026)

From Offline to Online Memory-Free and Task-Free Continual Learning via Fine-Grained Hypergradients
by: Michel, Nicolas, et al.
Published: (2025)

Sample Transform Cost-Based Training-Free Hallucination Detector for Large Language Models
by: Ding, Zeyang, et al.
Published: (2026)

No Free Lunch: Fundamental Limits of Learning Non-Hallucinating Generative Models
by: Wu, Changlong, et al.
Published: (2024)

Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Models
by: Wu, Shutong, et al.
Published: (2025)

TFGN: Task-Free, Replay-Free Continual Pre-Training Without Catastrophic Forgetting at LLM Scale
by: Ganguli, Anurup
Published: (2026)

Learning to Solve Job Shop Scheduling under Uncertainty
by: Infantes, Guillaume, et al.
Published: (2024)

Task Scheduling & Forgetting in Multi-Task Reinforcement Learning
by: Speckmann, Marc, et al.
Published: (2025)

Measurement Scheduling for ICU Patients with Offline Reinforcement Learning
by: Ji, Zongliang, et al.
Published: (2024)