Image de couverture de livre

Cyclical Log Annealing as a Learning Rate Scheduler

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Naveen, Philip
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Scaling Law with Learning Rate Annealing
par: Tissue, Howe, et autres
Publié: (2024)

ScheduleFree+: Scaling Learning-Rate-Free & Schedule-Free Learning to Large Language Models
par: Defazio, Aaron
Publié: (2026)

Optimal Linear Decay Learning Rate Schedules and Further Refinements
par: Defazio, Aaron, et autres
Publié: (2023)

Heterogeneous Learning Rate Scheduling for Neural Architecture Search on Long-Tailed Datasets
par: Tang, Chenxia
Publié: (2024)

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler
par: Dremov, Aleksandr, et autres
Publié: (2025)

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler
par: Shen, Yikang, et autres
Publié: (2024)

ContraLog: Log File Anomaly Detection with Contrastive Learning and Masked Language Modeling
par: Dietz, Simon, et autres
Publié: (2026)

CyclicFL: A Cyclic Model Pre-Training Approach to Efficient Federated Learning
par: Zhang, Pengyu, et autres
Publié: (2023)

Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling
par: Meterez, Alexandru, et autres
Publié: (2025)

Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging
par: Meterez, Alexandru, et autres
Publié: (2026)

Selecting Decision-Relevant Concepts in Reinforcement Learning
par: Raman, Naveen, et autres
Publié: (2026)

Machine Learning for Pattern Detection in Printhead Nozzle Logging
par: Prianikov, Nikola, et autres
Publié: (2025)

Annealing Machine-assisted Learning of Graph Neural Network for Combinatorial Optimization
par: Loyola, Pablo, et autres
Publié: (2025)

Learning Cyclic Causal Models from Incomplete Data
par: Sethuraman, Muralikrishnna G., et autres
Publié: (2024)

A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules
par: Luo, Kairong, et autres
Publié: (2025)

Non-equilibrium Annealed Adjoint Sampler
par: Choi, Jaemoo, et autres
Publié: (2025)

Annealing Optimization for Progressive Learning with Stochastic Approximation
par: Mavridis, Christos, et autres
Publié: (2022)

Learning From Scenarios for Stochastic Repairable Scheduling
par: Houten, Kim van den, et autres
Publié: (2023)

Offline Reinforcement Learning for Learning to Dispatch for Job Shop Scheduling
par: van Remmerden, Jesse, et autres
Publié: (2024)

Learning to Solve Job Shop Scheduling under Uncertainty
par: Infantes, Guillaume, et autres
Publié: (2024)

Measurement Scheduling for ICU Patients with Offline Reinforcement Learning
par: Ji, Zongliang, et autres
Publié: (2024)

Task Scheduling & Forgetting in Multi-Task Reinforcement Learning
par: Speckmann, Marc, et autres
Publié: (2025)

ReLA: Representation Learning and Aggregation for Job Scheduling with Reinforcement Learning
par: Kwan, Zhengyi, et autres
Publié: (2026)

Annealed Softmax Greedy in Many-Armed Bayesian Bandits
par: Overman, William, et autres
Publié: (2026)

Annealing Self-Distillation Rectification Improves Adversarial Training
par: Wu, Yu-Yu, et autres
Publié: (2023)

Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Sampling
par: Xu, Jian, et autres
Publié: (2024)

PearSAN: A Machine Learning Method for Inverse Design using Pearson Correlated Surrogate Annealing
par: Bezick, Michael, et autres
Publié: (2024)

An Adaptive Simulated Annealing-Based Machine Learning Approach for Developing an E-Triage Tool for Hospital Emergency Operations
par: Ahmed, Abdulaziz, et autres
Publié: (2022)

Efficient Approximate Posterior Sampling with Annealed Langevin Monte Carlo
par: Parulekar, Advait, et autres
Publié: (2025)

Policy Gradient with Adaptive Entropy Annealing for Continual Fine-Tuning
par: Zhang, Yaqian, et autres
Publié: (2026)

Scaling and Transferability of Annealing Strategies in Large Language Model Training
par: Wang, Siqi, et autres
Publié: (2025)

Towards Provable Log Density Policy Gradient
par: Katdare, Pulkit, et autres
Publié: (2024)

Adaptive Memory Decay for Log-Linear Attention
par: Amin, Yaxita, et autres
Publié: (2026)

Bounding Evidence and Estimating Log-Likelihood in VAE
par: Struski, Łukasz, et autres
Publié: (2022)

LogGuardQ: A Cognitive-Enhanced Reinforcement Learning Framework for Cybersecurity Anomaly Detection in Security Logs
par: de Sousa, Umberto Gonçalves
Publié: (2025)

RL-MSA: a Reinforcement Learning-based Multi-line bus Scheduling Approach
par: Liu, Yingzhuo
Publié: (2024)

Intelligent Learning Rate Distribution to reduce Catastrophic Forgetting in Transformers
par: Kenneweg, Philip, et autres
Publié: (2024)

Don't Forget the Critic: Value-Based Data Rehearsal for Multi-Cyclic Continual Reinforcement Learning
par: Poole, Benjamin, et autres
Publié: (2026)

Learning Memory-Enhanced Improvement Heuristics for Flexible Job Shop Scheduling
par: Wang, Jiaqi, et autres
Publié: (2026)

Deep Reinforcement Learning Guided Improvement Heuristic for Job Shop Scheduling
par: Zhang, Cong, et autres
Publié: (2022)