Cover Image

Structure-Preserving Network Compression Via Low-Rank Induced Training Through Linear Layers Composition

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Xitong, Alkhouri, Ismail R., Wang, Rongrong
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the Dataless Training of Neural Networks
by: Velasquez, Alvaro, et al.
Published: (2025)

A Principled Self-Referenced Early Stopping Approach for Deep Image Prior
by: Huang, Chaoyan, et al.
Published: (2026)

Personalizing Low-Rank Bayesian Neural Networks Via Federated Learning
by: Zhang, Boning, et al.
Published: (2024)

UGoDIT: Unsupervised Group Deep Image Prior Via Transferable Weights
by: Liang, Shijun, et al.
Published: (2025)

CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure
by: Kong, Boao, et al.
Published: (2025)

Differentiable Quadratic Optimization For The Maximum Independent Set Problem
by: Alkhouri, Ismail, et al.
Published: (2024)

Unlocking the Global Synergies in Low-Rank Adapters
by: Zhang, Zixi, et al.
Published: (2024)

Improving Generalization of Complex Models under Unbounded Loss Using PAC-Bayes Bounds
by: Zhang, Xitong, et al.
Published: (2023)

Theoretical Guarantees for Low-Rank Compression of Deep Neural Networks
by: Zhang, Shihao, et al.
Published: (2025)

On Generalization Bounds for Neural Networks with Low Rank Layers
by: Pinto, Andrea, et al.
Published: (2024)

Low-Rank Prehab: Preparing Neural Networks for SVD Compression
by: Qin, Haoran, et al.
Published: (2025)

Low-Rank Matrix Approximation for Neural Network Compression
by: Cherukuri, Kalyan, et al.
Published: (2025)

Low Rank and Sparse Fourier Structure in Recurrent Networks Trained on Modular Addition
by: Rangamani, Akshay
Published: (2025)

Privacy-Preserving 3-Layer Neural Network Training
by: Chiang, John
Published: (2023)

SaLoRA: Safety-Alignment Preserved Low-Rank Adaptation
by: Li, Mingjie, et al.
Published: (2025)

Low-Rank Learning by Design: the Role of Network Architecture and Activation Linearity in Gradient Rank Collapse
by: Baker, Bradley T., et al.
Published: (2024)

SITCOM: Step-wise Triple-Consistent Diffusion Sampling for Inverse Problems
by: Alkhouri, Ismail, et al.
Published: (2024)

Dynamic Low-Rank Sparse Adaptation for Large Language Models
by: Huang, Weizhong, et al.
Published: (2025)

Determining Layer-wise Sparsity for Large Language Models Through a Theoretical Perspective
by: Huang, Weizhong, et al.
Published: (2025)

A Dataless Reinforcement Learning Approach to Rounding Hyperplane Optimization for Max-Cut
by: Maliakal, Gabriel, et al.
Published: (2025)

Harnessing Orthogonality to Train Low-Rank Neural Networks
by: Coquelin, Daniel, et al.
Published: (2024)

CALR: Corrective Adaptive Low-Rank Decomposition for Efficient Large Language Model Layer Compression
by: Kautsar, Muchammad Daniyal, et al.
Published: (2025)

Structure-Preserving Margin Distribution Learning for High-Order Tensor Data with Low-Rank Decomposition
by: Xu, Yang, et al.
Published: (2025)

Robust Physics-based Deep MRI Reconstruction Via Diffusion Purification
by: Alkhouri, Ismail, et al.
Published: (2023)

A Single Linear Layer Yields Task-Adapted Low-Rank Matrices
by: Kim, Hwichan, et al.
Published: (2024)

An Overview of Low-Rank Structures in the Training and Adaptation of Large Models
by: Balzano, Laura, et al.
Published: (2025)

Dynamical Low-Rank Compression of Neural Networks with Robustness under Adversarial Attacks
by: Schotthöfer, Steffen, et al.
Published: (2025)

Dense Feature Learning via Linear Structure Preservation in Medical Data
by: Zhang, Yuanyun, et al.
Published: (2026)

Tada-DIP: Input-adaptive Deep Image Prior for One-shot 3D Image Reconstruction
by: Bell, Evan, et al.
Published: (2025)

Low-Rank Compression of Language Models via Differentiable Rank Selection
by: Sundrani, Sidhant, et al.
Published: (2025)

LaX: Boosting Low-Rank Training of Foundation Models via Latent Crossing
by: Zhang, Ruijie, et al.
Published: (2025)

Palu: Compressing KV-Cache with Low-Rank Projection
by: Chang, Chi-Chih, et al.
Published: (2024)

Learning Dynamics of Deep Linear Networks Beyond the Edge of Stability
by: Ghosh, Avrajit, et al.
Published: (2025)

Structure-Preserving Gaussian Processes Via Discrete Euler-Lagrange Equations
by: Ewering, Jan-Hendrik, et al.
Published: (2026)

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
by: Zhao, Jiawei, et al.
Published: (2024)

Hierarchical Sparse Plus Low Rank Compression of LLM
by: Kumar, Pawan, et al.
Published: (2025)

Clustering-Based Low-Rank Matrix Approximation for Medical Image Compression
by: Hamlomo, Sisipho, et al.
Published: (2025)

Fast Forwarding Low-Rank Training
by: Rahamim, Adir, et al.
Published: (2024)

LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy
by: Zhang, Rongzhi, et al.
Published: (2024)

Fundamental limits of Non-Linear Low-Rank Matrix Estimation
by: Mergny, Pierre, et al.
Published: (2024)