:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Peng, Bowen, Chen, Lizhang, Su, Baiyu, Quesnelle, Jeffrey, Kingma, Diederik P., Liu, Qiang
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	https://arxiv.org/abs/2411.19870
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

YaRN: Efficient Context Window Extension of Large Language Models
by: Peng, Bowen, et al.
Published: (2023)

Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts
by: Chen, Lizhang, et al.
Published: (2023)

Momentum Guidance: Plug-and-Play Guidance for Flow Models
by: Liao, Runlong, et al.
Published: (2026)

CurvaDion: Curvature-Adaptive Distributed Orthonormalization
by: Kumar, Bhavesh, et al.
Published: (2025)

Memory-Efficient LLM Training with Online Subspace Descent
by: Liang, Kaizhao, et al.
Published: (2024)

Cautious Optimizers: Improving Training with One Line of Code
by: Liang, Kaizhao, et al.
Published: (2024)

Positive-Unlabeled Constraint Learning for Inferring Nonlinear Continuous Constraints Functions from Expert Demonstrations
by: Peng, Baiyu, et al.
Published: (2024)

Learning Constraint Network from Demonstrations via Positive-Unlabeled Learning with Memory Replay
by: Peng, Baiyu, et al.
Published: (2024)

Adam-mini: Use Fewer Learning Rates To Gain More
by: Zhang, Yushun, et al.
Published: (2024)

MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning
by: Chen, Yupeng, et al.
Published: (2024)

Distributed Low-Communication Training with Decoupled Momentum Optimization
by: Nedelkoski, Sasho, et al.
Published: (2025)

EM Distillation for One-step Diffusion Models
by: Xie, Sirui, et al.
Published: (2024)

Input Domain Aware MoE: Decoupling Routing Decisions from Task Optimization in Mixture of Experts
by: Hua, Yongxiang, et al.
Published: (2025)

TrasMuon: Trust-Region Adaptive Scaling for Orthogonalized Momentum Optimizers
by: Cheng, Peng, et al.
Published: (2026)

Grouter: Decoupling Routing from Representation for Accelerated MoE Training
by: Xu, Yuqi, et al.
Published: (2026)

Training and Simulation of Quadrupedal Robot in Adaptive Stair Climbing for Indoor Firefighting: An End-to-End Reinforcement Learning Approach
by: Huang, Baixiao, et al.
Published: (2026)

On the Limits of Momentum in Decentralized and Federated Optimization
by: Zaccone, Riccardo, et al.
Published: (2025)

Momentum-integrated Multi-task Stock Recommendation with Converge-based Optimization
by: Wang, Hao, et al.
Published: (2025)

Communication Efficient Distributed Training with Distributed Lion
by: Liu, Bo, et al.
Published: (2024)

Muon Optimizes Under Spectral Norm Constraints
by: Chen, Lizhang, et al.
Published: (2025)

DRPO: Efficient Reasoning via Decoupled Reward Policy Optimization
by: Li, Gang, et al.
Published: (2025)

Jakiro: Boosting Speculative Decoding with Decoupled Multi-Head via MoE
by: Huang, Haiduo, et al.
Published: (2025)

Learning Robust Reasoning through Guided Adversarial Self-Play
by: Li, Shuozhe, et al.
Published: (2026)

DABstep: Data Agent Benchmark for Multi-step Reasoning
by: Egg, Alex, et al.
Published: (2025)

SMMF: Square-Matricized Momentum Factorization for Memory-Efficient Optimization
by: Park, Kwangryeol, et al.
Published: (2024)

Momentum Streams for Optimizer-Inspired Transformers
by: Gai, Jingchu, et al.
Published: (2026)

Memory-Efficient Optimization with Factorized Hamiltonian Descent
by: Nguyen, Son, et al.
Published: (2024)

Learning Transferability: A Two-Stage Reinforcement Learning Approach for Enhancing Quadruped Robots' Performance in U-Shaped Stair Climbing
by: Huang, Baixiao, et al.
Published: (2026)

Improving Adaptive Moment Optimization via Preconditioner Diagonalization
by: Nguyen, Son, et al.
Published: (2025)

The Illusion of Certainty: Decoupling Capability and Calibration in On-Policy Distillation
by: Zhang, Jiaxin, et al.
Published: (2026)

DeMo++: Motion Decoupling for Autonomous Driving
by: Zhang, Bozhou, et al.
Published: (2025)

Pretrain Value, Not Reward: Decoupled Value Policy Optimization
by: Huang, Chenghua, et al.
Published: (2025)

MoNTA: Accelerating Mixture-of-Experts Training with Network-Traffc-Aware Parallel Optimization
by: Guo, Jingming, et al.
Published: (2024)

DeToNATION: Decoupled Torch Network-Aware Training on Interlinked Online Nodes
by: From, Mogens Henrik, et al.
Published: (2025)

Batch Acquisition Function Evaluations and Decouple Optimizer Updates for Faster Bayesian Optimization
by: Irie, Kaichi, et al.
Published: (2025)

Deep Multi-Objective Reinforcement Learning for Utility-Based Infrastructural Maintenance Optimization
by: van Remmerden, Jesse, et al.
Published: (2024)

GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimization
by: Liu, Shih-Yang, et al.
Published: (2026)

Towards Flash Thinking via Decoupled Advantage Policy Optimization
by: Tan, Zezhong, et al.
Published: (2025)

Torque-Aware Momentum
by: Malviya, Pranshu, et al.
Published: (2024)

Excitation: Momentum For Experts
by: Shaier, Sagi
Published: (2026)