GNMR: Runtime Stability Control for Low-Precision Large Language Model Training
Fuente:
arXiv
Guardado en:
| Autores principales: | Kong, Boao, Jia, Weichen, Zhang, Engao, Li, Guohong, Dong, Yonghan, Wang, Yao, Wang, Yaoyuan, Peng, Yunke, Yuan, Kun |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
BROS: Bias-Corrected Randomized Subspaces for Memory-Efficient Single-Loop Bilevel Optimization
por: Zhang, Hengrui, et al.
Publicado: (2026)
por: Zhang, Hengrui, et al.
Publicado: (2026)
On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes
por: Kong, Boao, et al.
Publicado: (2026)
por: Kong, Boao, et al.
Publicado: (2026)
SPARKLE: A Unified Single-Loop Primal-Dual Framework for Decentralized Bilevel Optimization
por: Zhu, Shuchen, et al.
Publicado: (2024)
por: Zhu, Shuchen, et al.
Publicado: (2024)
Decentralized Bilevel Optimization: A Perspective from Transient Iteration Complexity
por: Kong, Boao, et al.
Publicado: (2024)
por: Kong, Boao, et al.
Publicado: (2024)
Clapping: Removing Per-sample Storage for Pipeline Parallel Distributed Optimization with Communication Compression
por: Kong, Boao, et al.
Publicado: (2025)
por: Kong, Boao, et al.
Publicado: (2025)
Greedy Low-Rank Gradient Compression for Distributed Learning with Convergence Guarantees
por: Chen, Chuyan, et al.
Publicado: (2025)
por: Chen, Chuyan, et al.
Publicado: (2025)
Stabilizing Rate of Stochastic Control Systems
por: Jia, Hui, et al.
Publicado: (2025)
por: Jia, Hui, et al.
Publicado: (2025)
Compressing Large Language Models using Low Rank and Low Precision Decomposition
por: Saha, Rajarshi, et al.
Publicado: (2024)
por: Saha, Rajarshi, et al.
Publicado: (2024)
An Overview of Low-Rank Structures in the Training and Adaptation of Large Models
por: Balzano, Laura, et al.
Publicado: (2025)
por: Balzano, Laura, et al.
Publicado: (2025)
SUDA-Muon: Structural Design Principles and Boundaries for Fully Decentralized Muon
por: Zhang, Hengrui, et al.
Publicado: (2026)
por: Zhang, Hengrui, et al.
Publicado: (2026)
Learning to Control Stabilization in Column Generation
por: Wang, Olivia, et al.
Publicado: (2026)
por: Wang, Olivia, et al.
Publicado: (2026)
CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure
por: Kong, Boao, et al.
Publicado: (2025)
por: Kong, Boao, et al.
Publicado: (2025)
Subspace Optimization for Large Language Models with Convergence Guarantees
por: He, Yutong, et al.
Publicado: (2024)
por: He, Yutong, et al.
Publicado: (2024)
Nonlinear Optimal Guidance for Impact Time Control with Field-of-View Constraint
por: Lu, Fangmin, et al.
Publicado: (2025)
por: Lu, Fangmin, et al.
Publicado: (2025)
GradPower: Powering Gradients for Faster Language Model Pre-Training
por: Wang, Jinbo, et al.
Publicado: (2025)
por: Wang, Jinbo, et al.
Publicado: (2025)
A Multi-scale Perimeter Control and Route Guidance System for Large-scale Road Networks
por: Peng, Xianyue, et al.
Publicado: (2025)
por: Peng, Xianyue, et al.
Publicado: (2025)
Safety on the Fly: Constructing Robust Safety Filters via Policy Control Barrier Functions at Runtime
por: Knoedler, Luzia, et al.
Publicado: (2024)
por: Knoedler, Luzia, et al.
Publicado: (2024)
Empirical Asymptotic Runtime Analysis of Linear Programming Algorithms
por: Rothberg, Edward
Publicado: (2026)
por: Rothberg, Edward
Publicado: (2026)
A Multi-objective Sequential Quadratic Programming Algorithm Based on Low-order Smooth Penalty Function
por: Kong, Zanyang
Publicado: (2025)
por: Kong, Zanyang
Publicado: (2025)
From PowerSGD to PowerSGD+: Low-Rank Gradient Compression for Distributed Optimization with Convergence Guarantees
por: Xie, Shengping, et al.
Publicado: (2025)
por: Xie, Shengping, et al.
Publicado: (2025)
A Proximal DC Algorithm for Sample Average Approximation of Chance Constrained Programming
por: Wang, Peng, et al.
Publicado: (2023)
por: Wang, Peng, et al.
Publicado: (2023)
Boundary Stabilization for the Rayleigh Beam System under Event-triggered Controls
por: Wang, Siwen, et al.
Publicado: (2026)
por: Wang, Siwen, et al.
Publicado: (2026)
Optimal Complexity in Byzantine-Robust Distributed Stochastic Optimization with Data Heterogeneity
por: Shi, Qiankun, et al.
Publicado: (2025)
por: Shi, Qiankun, et al.
Publicado: (2025)
Initial Error Tolerant Distributed Mean Field Control under Partial and Discrete Information
por: Jin, Yuxin, et al.
Publicado: (2025)
por: Jin, Yuxin, et al.
Publicado: (2025)
Reinforcement Learning for Distributed Transient Frequency Control with Stability and Safety Guarantees
por: Yuan, Zhenyi, et al.
Publicado: (2022)
por: Yuan, Zhenyi, et al.
Publicado: (2022)
Frictionless Hamiltonian Descent and Coordinate Hamiltonian Descent for Strongly Convex Quadratic Problems
por: Wang, Jun-Kun
Publicado: (2024)
por: Wang, Jun-Kun
Publicado: (2024)
LoCo: Low-Bit Communication Adaptor for Large-scale Model Training
por: Xie, Xingyu, et al.
Publicado: (2024)
por: Xie, Xingyu, et al.
Publicado: (2024)
Stability, Contraction, and Controllers for Affine Systems
por: Wieringa, L. P., et al.
Publicado: (2026)
por: Wieringa, L. P., et al.
Publicado: (2026)
Exact Controllability and Stabilization of the Wave Equation
por: Zuazua, Enrique
Publicado: (2024)
por: Zuazua, Enrique
Publicado: (2024)
Stochastic Model Predictive Control for Sub-Gaussian Noise
por: Ao, Yunke, et al.
Publicado: (2025)
por: Ao, Yunke, et al.
Publicado: (2025)
Latent Representations for Control Design with Provable Stability and Safety Guarantees
por: Lutkus, Paul, et al.
Publicado: (2025)
por: Lutkus, Paul, et al.
Publicado: (2025)
A Precise Characterization of SGD Stability Using Loss Surface Geometry
por: Dexter, Gregory, et al.
Publicado: (2024)
por: Dexter, Gregory, et al.
Publicado: (2024)
Perturbation-Tolerant Structural Controllability for Linear Systems
por: Zhang, Yuan, et al.
Publicado: (2021)
por: Zhang, Yuan, et al.
Publicado: (2021)
Analysis of Stability and Performance of Economic Model Predictive Control with State-Independent Costs
por: Arastou, Alireza, et al.
Publicado: (2026)
por: Arastou, Alireza, et al.
Publicado: (2026)
On the Exponential Stability of Koopman Model Predictive Control
por: Shang, Xu, et al.
Publicado: (2025)
por: Shang, Xu, et al.
Publicado: (2025)
MARS: Unleashing the Power of Variance Reduction for Training Large Models
por: Yuan, Huizhuo, et al.
Publicado: (2024)
por: Yuan, Huizhuo, et al.
Publicado: (2024)
Set-based Optimal, Robust, and Resilient Control with Applications to Autonomous Precision Landing
por: Kamath, Abhinav G., et al.
Publicado: (2025)
por: Kamath, Abhinav G., et al.
Publicado: (2025)
Low-Order Explicit Hessian Imitation Method for Large-Scale Supervised Machine Learning
por: Zhu, Yunlang, et al.
Publicado: (2026)
por: Zhu, Yunlang, et al.
Publicado: (2026)
Mixed-Precision GPU Acceleration for Large-Scale Minimum Enclosing Ball Problems
por: Liang, Ling, et al.
Publicado: (2026)
por: Liang, Ling, et al.
Publicado: (2026)
Does Weight Decay Enhance Training Stability?
por: Saether, Marius, et al.
Publicado: (2026)
por: Saether, Marius, et al.
Publicado: (2026)
Ejemplares similares
-
BROS: Bias-Corrected Randomized Subspaces for Memory-Efficient Single-Loop Bilevel Optimization
por: Zhang, Hengrui, et al.
Publicado: (2026) -
On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes
por: Kong, Boao, et al.
Publicado: (2026) -
SPARKLE: A Unified Single-Loop Primal-Dual Framework for Decentralized Bilevel Optimization
por: Zhu, Shuchen, et al.
Publicado: (2024) -
Decentralized Bilevel Optimization: A Perspective from Transient Iteration Complexity
por: Kong, Boao, et al.
Publicado: (2024) -
Clapping: Removing Per-sample Storage for Pipeline Parallel Distributed Optimization with Communication Compression
por: Kong, Boao, et al.
Publicado: (2025)