Cover Image

An Overview of Low-Rank Structures in the Training and Adaptation of Large Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Balzano, Laura, Ding, Tianjiao, Haeffele, Benjamin D., Kwon, Soo Min, Qu, Qing, Wang, Peng, Wang, Zhangyang, Yaras, Can
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Signal Processing Optimization and Control Computation
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation
by: Yaras, Can, et al.
Published: (2024)

Out-of-Distribution Generalization of In-Context Learning: A Low-Dimensional Subspace Perspective
by: Kwon, Soo Min, et al.
Published: (2025)

Emergent Low-Rank Training Dynamics in MLPs with Smooth Activations
by: Xu, Alec S., et al.
Published: (2026)

Understanding Deep Representation Learning via Layerwise Feature Compression and Discrimination
by: Wang, Peng, et al.
Published: (2023)

A Semidefinite Relaxation for Sums of Heterogeneous Quadratic Forms on the Stiefel Manifold
by: Gilman, Kyle, et al.
Published: (2022)

ODELoRA: Training Low-Rank Adaptation by Solving Ordinary Differential Equations
by: Gao, Yihang, et al.
Published: (2026)

Automatic Rank Determination for Low-Rank Adaptation via Submodular Function Maximization
by: Gao, Yihang, et al.
Published: (2025)

The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing
by: Xu, Xingyu, et al.
Published: (2023)

The number of global solutions for GPS source localization in two-dimension
by: Kwon, Kiwoon
Published: (2024)

Robust Low-rank Tensor Train Recovery
by: Qin, Zhen, et al.
Published: (2024)

PoLAR: Polar-Decomposed Low-Rank Adapter Representation
by: Lion, Kai, et al.
Published: (2025)

Exactly or Approximately Wasserstein Distributionally Robust Estimation According to Wasserstein Radii Being Small or Large
by: Ding, Xiao, et al.
Published: (2025)

Minimization of Nonsmooth Weakly Convex Function over Prox-regular Set for Robust Low-rank Matrix Recovery
by: Kume, Keita, et al.
Published: (2025)

A Proximal DC Algorithm for Sample Average Approximation of Chance Constrained Programming
by: Wang, Peng, et al.
Published: (2023)

Joint Sampling Frequency Offset Estimation and Compensation Algorithms Based on the Farrow Structure
by: Linares, Deijany Rodriguez, et al.
Published: (2026)

Energy-Efficient Data Offloading for Earth Observation Satellite Networks
by: He, Lijun, et al.
Published: (2024)

Low-Rank Adaptation Redux for Large Models
by: Li, Bingcong, et al.
Published: (2026)

Guaranteed Nonconvex Factorization Approach for Tensor Train Recovery
by: Qin, Zhen, et al.
Published: (2024)

Computational and Statistical Guarantees for Tensor-on-Tensor Regression with Tensor Train Decomposition
by: Qin, Zhen, et al.
Published: (2024)

Joint Reproduction Number and Spatial Connectivity Structure Estimation via Graph Sparsity-Promoting Penalized Functional
by: Lasalle, Etienne, et al.
Published: (2025)

Optimal Allocation of Pauli Measurements for Low-rank Quantum State Tomography
by: Qin, Zhen, et al.
Published: (2024)

Time-Varying Graph Signal Recovery Using High-Order Smoothness and Adaptive Low-rankness
by: Guo, Weihong, et al.
Published: (2024)

Locality Regularized Reconstruction: Structured Sparsity and Delaunay Triangulations
by: Mueller, Marshall, et al.
Published: (2024)

Covariance-Based Activity Detection in Cooperative Multi-Cell Massive MIMO: Scaling Law and Efficient Algorithms
by: Wang, Ziyue, et al.
Published: (2023)

A Scalable Factorization Approach for High-Order Structured Tensor Recovery
by: Qin, Zhen, et al.
Published: (2025)

Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics
by: Kwon, Soo Min, et al.
Published: (2023)

An Efficient Benders Decomposition Approach for Optimal Large-Scale Network Slicing
by: Chen, Wei-Kun, et al.
Published: (2023)

MonarchAttention: Zero-Shot Conversion to Fast, Hardware-Aware Structured Attention
by: Yaras, Can, et al.
Published: (2025)

A Proximal Variable Smoothing for Minimization of Nonlinearly Composite Nonsmooth Function -- Maxmin Dispersion and MIMO Applications
by: Kume, Keita, et al.
Published: (2025)

Constrained Stochastic Recursive Momentum Successive Convex Approximation
by: Idrees, Basil M., et al.
Published: (2024)

Data-Driven Two-Stage IRS-Aided Sumrate Maximization with Inexact Precoding
by: Hashmi, Hassaan, et al.
Published: (2025)

Convex Estimation of Sparse-Smooth Power Spectral Densities from Mixtures of Realizations with Application to Weather Radar
by: Kuroda, Hiroki, et al.
Published: (2023)

Anchored Spectral Estimator for Rigid Motion Synchronization
by: Zhao, Ziyue, et al.
Published: (2026)

A Robust EDM Optimization Approach for 3D Single-Source Localization with Angle and Range Measurements
by: Zhao, Mingyu, et al.
Published: (2025)

Mathematical Optimization-Based Period Estimation with Outliers and Missing Observations
by: Puech, Romain, et al.
Published: (2024)

Learned Finite-Time Consensus for Distributed Optimization
by: Fainman, Aaron, et al.
Published: (2024)

Extreme Point Pursuit -- Part I: A Framework for Constant Modulus Optimization
by: Liu, Junbin, et al.
Published: (2024)

Appointment scheduling model in healthcare using clustering algorithms
by: Yousefi, Niloofar, et al.
Published: (2019)

Notch Filters without Transient Effects: A Constrained Optimization Design
by: Sameni, Reza
Published: (2024)

Efficient Constrained Signal Reconstruction by Randomized Epigraphical Projection
by: Ono, Shunsuke
Published: (2018)