:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Author:	Ren, Kieran Chai Kai
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2507.10575
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DeepSVM: Learning Stochastic Volatility Models with Physics-Informed Deep Operator Networks
by: Malandain, Kieran A., et al.
Published: (2025)

Deep Adaptive Rate Allocation in Volatile Heterogeneous Wireless Networks
by: Maglione, Gregorio, et al.
Published: (2026)

Decoupled Relative Learning Rate Schedules
by: Ludziejewski, Jan, et al.
Published: (2025)

Graph Neural Network-Based Collaborative Perception for Adaptive Scheduling in Distributed Systems
by: Zhu, Wenxuan, et al.
Published: (2025)

Learning Rate Scheduling with Matrix Factorization for Private Training
by: Kalinin, Nikita P., et al.
Published: (2025)

Learning Rate Schedules in the Presence of Distribution Shift
by: Fahrbach, Matthew, et al.
Published: (2023)

ScheduleFree+: Scaling Learning-Rate-Free & Schedule-Free Learning to Large Language Models
by: Defazio, Aaron
Published: (2026)

AdaLomo: Low-memory Optimization with Adaptive Learning Rate
by: Lv, Kai, et al.
Published: (2023)

Cyclical Log Annealing as a Learning Rate Scheduler
by: Naveen, Philip
Published: (2024)

Optimal Linear Decay Learning Rate Schedules and Further Refinements
by: Defazio, Aaron, et al.
Published: (2023)

Functional Scaling Laws in Kernel Regression: Loss Dynamics and Learning Rate Schedules
by: Li, Binghui, et al.
Published: (2025)

Cumulative Learning Rate Adaptation: Revisiting Path-Based Schedules for SGD and Adam
by: Atamna, Asma, et al.
Published: (2025)

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler
by: Shen, Yikang, et al.
Published: (2024)

Averaging Rate Scheduler for Decentralized Learning on Heterogeneous Data
by: Aketi, Sai Aparna, et al.
Published: (2024)

Adaptive Batch Size and Learning Rate Scheduler for Stochastic Gradient Descent Based on Minimization of Stochastic First-order Oracle Complexity
by: Umeda, Hikaru, et al.
Published: (2025)

Optimal Learning Rate Schedule for Balancing Effort and Performance
by: Njaradi, Valentina, et al.
Published: (2026)

Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training
by: Singh, Vaibhav, et al.
Published: (2025)

MILES: Modality-Informed Learning Rate Scheduler for Balancing Multimodal Learning
by: Guerra-Manzanares, Alejandro, et al.
Published: (2025)

Randomness Helps Rigor: A Probabilistic Learning Rate Scheduler Bridging Theory and Deep Learning Practice
by: Devapriya, Dahlia, et al.
Published: (2024)

Accelerating SGDM via Learning Rate and Batch Size Schedules: A Lyapunov-Based Analysis
by: Kondo, Yuichi, et al.
Published: (2025)

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler
by: Dremov, Aleksandr, et al.
Published: (2025)

Heterogeneous Learning Rate Scheduling for Neural Architecture Search on Long-Tailed Datasets
by: Tang, Chenxia
Published: (2024)

From independent patches to coordinated attention: Controlling information flow in vision transformers
by: Murphy, Kieran A.
Published: (2026)

VISP: Volatility Informed Stochastic Projection for Adaptive Regularization
by: Islam, Tanvir
Published: (2025)

Understanding the Generalization Benefits of Late Learning Rate Decay
by: Ren, Yinuo, et al.
Published: (2024)

Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling
by: Meterez, Alexandru, et al.
Published: (2025)

Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging
by: Meterez, Alexandru, et al.
Published: (2026)

Optimal Learning-Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay
by: Li, Binghui, et al.
Published: (2026)

Semantic Scheduling for LLM Inference
by: Hua, Wenyue, et al.
Published: (2025)

Adaptive Gain Scheduling using Reinforcement Learning for Quadcopter Control
by: Timmerman, Mike, et al.
Published: (2024)

Optimal Growth Schedules for Batch Size and Learning Rate in SGD that Reduce SFO Complexity
by: Umeda, Hikaru, et al.
Published: (2025)

Adaptive Double-Booking Strategy for Outpatient Scheduling Using Multi-Objective Reinforcement Learning
by: Amalina, Ninda Nurseha, et al.
Published: (2026)

Taking the Road Less Scheduled with Adaptive Polyak Steps
by: Oikonomou, Dimitris, et al.
Published: (2025)

Reinforcement Learning for Adaptive Resource Scheduling in Complex System Environments
by: Li, Pochun, et al.
Published: (2024)

The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training
by: Schaipp, Fabian, et al.
Published: (2025)

Fine-Tuning Without Forgetting via Loss-Adaptive Learning Rates
by: Prashant, Parjanya Prajakta, et al.
Published: (2026)

Enforcing Constraints in Generative Sampling via Adaptive Correction Scheduling
by: Trupin, Noah, et al.
Published: (2026)

A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules
by: Luo, Kairong, et al.
Published: (2025)

Theory of Optimal Learning Rate Schedules and Scaling Laws for a Random Feature Model
by: Bordelon, Blake, et al.
Published: (2026)

Multi-Objective Adaptive Rate Limiting in Microservices Using Deep Reinforcement Learning
by: Lyu, Ning, et al.
Published: (2025)