Image de couverture de livre

Low-Rank Compression of Pretrained Models via Randomized Subspace Iteration

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Pourkamali-Anaraki, Farhad
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Artificial Intelligence Numerical Analysis
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Aerial Image Classification in Scarce and Unconstrained Environments via Conformal Prediction
par: Pourkamali-Anaraki, Farhad
Publié: (2025)

Kolmogorov-Arnold Networks in Low-Data Regimes: A Comparative Study with Multilayer Perceptrons
par: Pourkamali-Anaraki, Farhad
Publié: (2024)

Probabilistic Neural Networks (PNNs) for Modeling Aleatoric Uncertainty in Scientific Machine Learning
par: Pourkamali-Anaraki, Farhad, et autres
Publié: (2024)

Low-Rank Adversarial PGD Attack
par: Savostianova, Dayana, et autres
Publié: (2024)

Accelerating Eigenvalue Dataset Generation via Chebyshev Subspace Filter
par: Wang, Hong, et autres
Publié: (2025)

Probabilistic Neural Networks (PNNs) with t-Distributed Outputs: Adaptive Prediction Intervals Beyond Gaussian Assumptions
par: Pourkamali-Anaraki, Farhad
Publié: (2025)

Accelerating Data Generation for Neural Operators via Krylov Subspace Recycling
par: Wang, Hong, et autres
Publié: (2024)

Learning to Discover Iterative Spectral Algorithms
par: Liu, Zihang, et autres
Publié: (2026)

IFNSO: Iteration-Free Newton-Schulz Orthogonalization
par: Hu, Chen, et autres
Publié: (2026)

Random Subspace Cubic-Regularization Methods, with Applications to Low-Rank Functions
par: Cartis, Coralia, et autres
Publié: (2025)

Ensemble-Based Dirichlet Modeling for Predictive Uncertainty and Selective Classification
par: Franzen, Courtney, et autres
Publié: (2026)

Sparse $L^1$-Autoencoders for Scientific Data Compression
par: Chung, Matthias, et autres
Publié: (2024)

Advancing the Understanding of Fixed Point Iterations in Deep Neural Networks: A Detailed Analytical Study
par: Ke, Yekun, et autres
Publié: (2024)

Random weights of DNNs and emergence of fixed points
par: Berlyand, L., et autres
Publié: (2025)

Quasi-Random Physics-informed Neural Networks
par: Yu, Tianchi, et autres
Publié: (2025)

Robust Non-Linear Correlations via Polynomial Regression
par: Giuliani, Luca, et autres
Publié: (2025)

Transformers Can Implement Preconditioned Richardson Iteration for In-Context Gaussian Kernel Regression
par: Yan, Mingsong, et autres
Publié: (2026)

Robust low-rank training via approximate orthonormal constraints
par: Savostianova, Dayana, et autres
Publié: (2023)

Quasi-Framelets: Robust Graph Neural Networks via Adaptive Framelet Convolution
par: Yang, Mengxi, et autres
Publié: (2022)

ProFlow: Zero-Shot Physics-Consistent Sampling via Proximal Flow Guidance
par: Yu, Zichao, et autres
Publié: (2026)

CFO: Learning Continuous-Time PDE Dynamics via Flow-Matched Neural Operators
par: Hou, Xianglong, et autres
Publié: (2025)

Fast Neural Tangent Kernel Alignment, Norm and Effective Rank via Trace Estimation
par: Hazelden, James
Publié: (2025)

Shape-informed cardiac mechanics surrogates in data-scarce regimes via geometric encoding and generative augmentation
par: Carrara, Davide, et autres
Publié: (2026)

ELM-DeepONets: Backpropagation-Free Training of Deep Operator Networks via Extreme Learning Machines
par: Son, Hwijae
Publié: (2025)

Numerical Instability and Chaos: Quantifying the Unpredictability of Large Language Models
par: Islam, Chashi Mahiul, et autres
Publié: (2026)

DeepContour: A Hybrid Deep Learning Framework for Accelerating Generalized Eigenvalue Problem Solving via Efficient Contour Design
par: Chen, Yeqiu, et autres
Publié: (2025)

Dynamical Low-Rank Compression of Neural Networks with Robustness under Adversarial Attacks
par: Schotthöfer, Steffen, et autres
Publié: (2025)

Defining Foundation Models for Computational Science: A Call for Clarity and Rigor
par: Choi, Youngsoo, et autres
Publié: (2025)

On Stochastic Rounding with Few Random Bits
par: Fitzgibbon, Andrew, et autres
Publié: (2025)

Graph Neural Network as Computationally Efficient Emulator of Ice-sheet and Sea-level System Model (ISSM)
par: Koo, Younghyun, et autres
Publié: (2024)

Online Pseudo-average Shifting Attention(PASA) for Robust Low-precision LLM Inference: Algorithms and Numerical Analysis
par: Cheng, Long, et autres
Publié: (2025)

Muon is Not That Special: Random or Inverted Spectra Work Just as Well
par: Shumaylov, Zakhar, et autres
Publié: (2026)

Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles
par: Farzin, Amir Ali, et autres
Publié: (2025)

Spectral Informed Neural Network: An Efficient and Low-Memory PINN
par: Yu, Tianchi, et autres
Publié: (2024)

Min-Max Optimisation for Nonconvex-Nonconcave Functions Using a Random Zeroth-Order Extragradient Algorithm
par: Farzin, Amir Ali, et autres
Publié: (2025)

Lower Bounds for the Convergence of Tensor Power Iteration on Random Overcomplete Models
par: Wu, Yuchen, et autres
Publié: (2022)

Physics-Informed Inference Time Scaling for Solving High-Dimensional PDE via Defect Correction
par: Fan, Zexi, et autres
Publié: (2025)

Autoregression-Free Neural Operators for Time-Dependent PDEs
par: Zhang, Jiaquan, et autres
Publié: (2026)

Core-Halo Decomposition: Decentralizing Large-Scale Fixed-Point Problems
par: Haixiang, et autres
Publié: (2026)

Leveraging Gauge Freedom for Learning Non-Gradient Population Dynamics of Stochastic Systems
par: Berman, Jules, et autres
Publié: (2026)