Cover Image

MLorc: Momentum Low-rank Compression for Memory Efficient Large Language Model Adaptation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shen, Wei, Yaxiang, Zhang, Huang, Minhui, Xu, Mengfan, Zhang, Jiawei, Shen, Cong
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Information Theory Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Stochastic Smoothed Gradient Descent Ascent for Federated Minimax Optimization
by: Shen, Wei, et al.
Published: (2023)

A Single-Loop First-Order Algorithm for Linearly Constrained Bilevel Optimization
by: Shen, Wei, et al.
Published: (2025)

On the Convergence Analysis of Muon
by: Shen, Wei, et al.
Published: (2025)

Local Geometry Determines Global Landscape in Low-rank Factorization for Synchronization
by: Ling, Shuyang
Published: (2023)

Nonconvex Factorization and Manifold Formulations are Almost Equivalent in Low-rank Matrix Optimization
by: Luo, Yuetian, et al.
Published: (2021)

An Efficient Benders Decomposition Approach for Optimal Large-Scale Network Slicing
by: Chen, Wei-Kun, et al.
Published: (2023)

Auto-Calibration and Biconvex Compressive Sensing with Applications to Parallel MRI
by: Ni, Yuan, et al.
Published: (2024)

Structured Gradient Descent for Fast Robust Low-Rank Hankel Matrix Completion
by: Cai, HanQin, et al.
Published: (2022)

Efficient URLLC with a Reconfigurable Intelligent Surface and Imperfect Device Tracking
by: Saggese, Fabio, et al.
Published: (2022)

Sleep or Transmit: Dual-Mode Energy-Efficient Design for NOMA-Enabled Backscatter Networks
by: Hassani, Hajar El, et al.
Published: (2026)

Convexity in Disguise: A Theoretical Framework for Nonconvex Low-Rank Matrix Estimation
by: Cui, Chengyu, et al.
Published: (2026)

Approximation Schemes for Age of Information Minimization in UAV Grid Patrols
by: Wang, Weiqi, et al.
Published: (2024)

ODELoRA: Training Low-Rank Adaptation by Solving Ordinary Differential Equations
by: Gao, Yihang, et al.
Published: (2026)

Automatic Rank Determination for Low-Rank Adaptation via Submodular Function Maximization
by: Gao, Yihang, et al.
Published: (2025)

Theory of Compression Channels for Postselected Quantum Metrology
by: Yang, Jing
Published: (2023)

Low-rank Tensor Autoregressive Predictor for Third-Order Time-Series Forecasting
by: Wang, Haoning, et al.
Published: (2024)

QoS-based Beamforming and Compression Design for Cooperative Cellular Networks via Lagrangian Duality
by: Fan, Xilai, et al.
Published: (2023)

High-probability sample complexities for policy evaluation with linear function approximation
by: Li, Gen, et al.
Published: (2023)

Covariance-Based Activity Detection in Cooperative Multi-Cell Massive MIMO: Scaling Law and Efficient Algorithms
by: Wang, Ziyue, et al.
Published: (2023)

An Adaptive Proximal Inexact Gradient Framework and Its Application to Per-Antenna Constrained Joint Beamforming and Compression Design
by: Fan, Xilai, et al.
Published: (2025)

Non-convex matrix sensing: Breaking the quadratic rank barrier in the sample complexity
by: Stöger, Dominik, et al.
Published: (2024)

Adversarial Water-Filling: Theory, Algorithms and Foundation Model
by: Tong, Xindi, et al.
Published: (2026)

Decentralized Uplink Adaptive Compression for Cell-Free MIMO with Limited Fronthaul
by: Li, Zehua, et al.
Published: (2025)

Efficient Computation of the Quantum Rate-Distortion Function
by: He, Kerry, et al.
Published: (2023)

Breaking the Sample Size Barrier in Model-Based Reinforcement Learning with a Generative Model
by: Li, Gen, et al.
Published: (2020)

Beyond-Diagonal RIS For Enhanced Secrecy and Sensing Gains in Secure ISAC Networks: An Optimization Framework
by: Illi, Elmehdi, et al.
Published: (2026)

Radon random sampling and reconstruction in local shift-invariant signal space
by: Deng, Zhanpeng, et al.
Published: (2025)

Remote State Estimation over Unreliable Channels with Unreliable Feedback: Strategies and Limits
by: Soleymani, Touraj, et al.
Published: (2025)

Reinforcement Learning for Near-Optimal Design of Zero-Delay Codes for Markov Sources
by: Cregg, Liam, et al.
Published: (2023)

Networked Control with Hybrid Automatic Repeat Request Protocols
by: Soleymani, Touraj, et al.
Published: (2024)

Goal-Oriented Communication for Networked Control Assisted by Reconfigurable Meta-Surfaces
by: Assaad, Mohamad, et al.
Published: (2024)

Optimal Denial-of-Service Attacks Against Partially-Observable Real-Time Monitoring Systems
by: Kriouile, Saad, et al.
Published: (2024)

Delay-Optimal Transmission Scheduling Policies for Time-Correlated Fading Channels
by: Dutta, Manali, et al.
Published: (2025)

Feedback Control via Integrated Sensing and Communication: Uncertainty Optimisation
by: Soleymani, Touraj, et al.
Published: (2026)

Accelerated Bregmann divergence optimization with SMART: an information geometry point of view
by: Raus, Maren, et al.
Published: (2024)

Consistency of Value of Information: Effects of Packet Loss and Time Delay in Networked Control Systems Tasks
by: Soleymani, Touraj, et al.
Published: (2024)

Optimal Gaussian Strategies for Vector-valued Witsenhausen Counterexample with Non-causal State Estimator
by: Zhao, Mengyuan, et al.
Published: (2024)

Reinforcement Learning Design for Quickest Change Detection
by: Cooper, Austin, et al.
Published: (2024)

Automatic Generation of Examinations in the Automatic Control Courses
by: Stotsky, Alexander, et al.
Published: (2024)

A Fast and Provable Algorithm for Sparse Phase Retrieval
by: Cai, Jian-Feng, et al.
Published: (2023)