Imagen de Portada

GNMR: Runtime Stability Control for Low-Precision Large Language Model Training

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kong, Boao, Jia, Weichen, Zhang, Engao, Li, Guohong, Dong, Yonghan, Wang, Yao, Wang, Yaoyuan, Peng, Yunke, Yuan, Kun
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

BROS: Bias-Corrected Randomized Subspaces for Memory-Efficient Single-Loop Bilevel Optimization
por: Zhang, Hengrui, et al.
Publicado: (2026)

On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes
por: Kong, Boao, et al.
Publicado: (2026)

SPARKLE: A Unified Single-Loop Primal-Dual Framework for Decentralized Bilevel Optimization
por: Zhu, Shuchen, et al.
Publicado: (2024)

Decentralized Bilevel Optimization: A Perspective from Transient Iteration Complexity
por: Kong, Boao, et al.
Publicado: (2024)

Clapping: Removing Per-sample Storage for Pipeline Parallel Distributed Optimization with Communication Compression
por: Kong, Boao, et al.
Publicado: (2025)

Greedy Low-Rank Gradient Compression for Distributed Learning with Convergence Guarantees
por: Chen, Chuyan, et al.
Publicado: (2025)

Stabilizing Rate of Stochastic Control Systems
por: Jia, Hui, et al.
Publicado: (2025)

Compressing Large Language Models using Low Rank and Low Precision Decomposition
por: Saha, Rajarshi, et al.
Publicado: (2024)

An Overview of Low-Rank Structures in the Training and Adaptation of Large Models
por: Balzano, Laura, et al.
Publicado: (2025)

SUDA-Muon: Structural Design Principles and Boundaries for Fully Decentralized Muon
por: Zhang, Hengrui, et al.
Publicado: (2026)

Learning to Control Stabilization in Column Generation
por: Wang, Olivia, et al.
Publicado: (2026)

CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure
por: Kong, Boao, et al.
Publicado: (2025)

Subspace Optimization for Large Language Models with Convergence Guarantees
por: He, Yutong, et al.
Publicado: (2024)

Nonlinear Optimal Guidance for Impact Time Control with Field-of-View Constraint
por: Lu, Fangmin, et al.
Publicado: (2025)

GradPower: Powering Gradients for Faster Language Model Pre-Training
por: Wang, Jinbo, et al.
Publicado: (2025)

A Multi-scale Perimeter Control and Route Guidance System for Large-scale Road Networks
por: Peng, Xianyue, et al.
Publicado: (2025)

Safety on the Fly: Constructing Robust Safety Filters via Policy Control Barrier Functions at Runtime
por: Knoedler, Luzia, et al.
Publicado: (2024)

Empirical Asymptotic Runtime Analysis of Linear Programming Algorithms
por: Rothberg, Edward
Publicado: (2026)

A Multi-objective Sequential Quadratic Programming Algorithm Based on Low-order Smooth Penalty Function
por: Kong, Zanyang
Publicado: (2025)

From PowerSGD to PowerSGD+: Low-Rank Gradient Compression for Distributed Optimization with Convergence Guarantees
por: Xie, Shengping, et al.
Publicado: (2025)

A Proximal DC Algorithm for Sample Average Approximation of Chance Constrained Programming
por: Wang, Peng, et al.
Publicado: (2023)

Boundary Stabilization for the Rayleigh Beam System under Event-triggered Controls
por: Wang, Siwen, et al.
Publicado: (2026)

Optimal Complexity in Byzantine-Robust Distributed Stochastic Optimization with Data Heterogeneity
por: Shi, Qiankun, et al.
Publicado: (2025)

Initial Error Tolerant Distributed Mean Field Control under Partial and Discrete Information
por: Jin, Yuxin, et al.
Publicado: (2025)

Reinforcement Learning for Distributed Transient Frequency Control with Stability and Safety Guarantees
por: Yuan, Zhenyi, et al.
Publicado: (2022)

Frictionless Hamiltonian Descent and Coordinate Hamiltonian Descent for Strongly Convex Quadratic Problems
por: Wang, Jun-Kun
Publicado: (2024)

LoCo: Low-Bit Communication Adaptor for Large-scale Model Training
por: Xie, Xingyu, et al.
Publicado: (2024)

Stability, Contraction, and Controllers for Affine Systems
por: Wieringa, L. P., et al.
Publicado: (2026)

Exact Controllability and Stabilization of the Wave Equation
por: Zuazua, Enrique
Publicado: (2024)

Stochastic Model Predictive Control for Sub-Gaussian Noise
por: Ao, Yunke, et al.
Publicado: (2025)

Latent Representations for Control Design with Provable Stability and Safety Guarantees
por: Lutkus, Paul, et al.
Publicado: (2025)

A Precise Characterization of SGD Stability Using Loss Surface Geometry
por: Dexter, Gregory, et al.
Publicado: (2024)

Perturbation-Tolerant Structural Controllability for Linear Systems
por: Zhang, Yuan, et al.
Publicado: (2021)

Analysis of Stability and Performance of Economic Model Predictive Control with State-Independent Costs
por: Arastou, Alireza, et al.
Publicado: (2026)

On the Exponential Stability of Koopman Model Predictive Control
por: Shang, Xu, et al.
Publicado: (2025)

MARS: Unleashing the Power of Variance Reduction for Training Large Models
por: Yuan, Huizhuo, et al.
Publicado: (2024)

Set-based Optimal, Robust, and Resilient Control with Applications to Autonomous Precision Landing
por: Kamath, Abhinav G., et al.
Publicado: (2025)

Low-Order Explicit Hessian Imitation Method for Large-Scale Supervised Machine Learning
por: Zhu, Yunlang, et al.
Publicado: (2026)

Mixed-Precision GPU Acceleration for Large-Scale Minimum Enclosing Ball Problems
por: Liang, Ling, et al.
Publicado: (2026)

Does Weight Decay Enhance Training Stability?
por: Saether, Marius, et al.
Publicado: (2026)