Cover Image

Low-Rank Tensor Decompositions for the Theory of Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Borsoi, Ricardo, Usevich, Konstantin, Clausel, Marianne
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Identifiability of Deep Polynomial Neural Networks
by: Usevich, Konstantin, et al.
Published: (2025)

Personalized Coupled Tensor Decomposition for Multimodal Data Fusion: Uniqueness and Algorithms
by: Borsoi, Ricardo Augusto, et al.
Published: (2024)

Low Tensor-Rank Adaptation of Kolmogorov--Arnold Networks
by: Gao, Yihang, et al.
Published: (2025)

Adaptive Regime-Switching Forecasts with Distribution-Free Uncertainty: Deep Switching State-Space Models Meet Conformal Prediction
by: LU, Echo Diyun, et al.
Published: (2025)

Harnessing Orthogonality to Train Low-Rank Neural Networks
by: Coquelin, Daniel, et al.
Published: (2024)

Joint Tensor-Train Parameterization for Efficient and Expressive Low-Rank Adaptation
by: Qi, Jun, et al.
Published: (2025)

Tensor and Matrix Low-Rank Value-Function Approximation in Reinforcement Learning
by: Rozada, Sergio, et al.
Published: (2022)

Learning Semilinear Neural Operators : A Unified Recursive Framework For Prediction And Data Assimilation
by: Singh, Ashutosh, et al.
Published: (2024)

TEN-GUARD: Tensor Decomposition for Backdoor Attack Detection in Deep Neural Networks
by: Hossain, Khondoker Murad, et al.
Published: (2024)

OATS: Outlier-Aware Pruning Through Sparse and Low Rank Decomposition
by: Zhang, Stephen, et al.
Published: (2024)

Optimal Policy Sparsification and Low Rank Decomposition for Deep Reinforcement Learning
by: Goddla, Vikram
Published: (2024)

MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuning
by: Wang, Maolin, et al.
Published: (2025)

LoTR: Low Tensor Rank Weight Adaptation
by: Bershatsky, Daniel, et al.
Published: (2024)

No Imputation Needed: A Switch Approach to Irregularly Sampled Time Series
by: Agarwal, Rohit, et al.
Published: (2023)

Sparse Decomposition of Graph Neural Networks
by: Hu, Yaochen, et al.
Published: (2024)

Decoupling General and Personalized Knowledge in Federated Learning via Additive and Low-Rank Decomposition
by: Wu, Xinghao, et al.
Published: (2024)

Tensor-view Topological Graph Neural Network
by: Wen, Tao, et al.
Published: (2024)

Compressing Large Language Models using Low Rank and Low Precision Decomposition
by: Saha, Rajarshi, et al.
Published: (2024)

KODA: A Data-Driven Recursive Model for Time Series Forecasting and Data Assimilation using Koopman Operators
by: Singh, Ashutosh, et al.
Published: (2024)

CALR: Corrective Adaptive Low-Rank Decomposition for Efficient Large Language Model Layer Compression
by: Kautsar, Muchammad Daniyal, et al.
Published: (2025)

MUXQ: Mixed-to-Uniform Precision MatriX Quantization via Low-Rank Outlier Decomposition
by: Lee, Seoungsub, et al.
Published: (2026)

Towards LLM-guided Efficient and Interpretable Multi-linear Tensor Network Rank Selection
by: Iacovides, Giorgos, et al.
Published: (2024)

Toward Temporal Causal Representation Learning with Tensor Decomposition
by: Chen, Jianhong, et al.
Published: (2025)

Attention-based Iterative Decomposition for Tensor Product Representation
by: Park, Taewon, et al.
Published: (2024)

Compressing Neural Networks Using Tensor Networks with Exponentially Fewer Variational Parameters
by: Qing, Yong, et al.
Published: (2023)

Automatically Differentiable Nonlinear Tensor Networks (ADNTNs) for Exponential Compression of Deep Neural Networks
by: Cichocki, Andrzej, et al.
Published: (2026)

SamBaTen: Sampling-based Batch Incremental Tensor Decomposition
by: Gujral, Ekta, et al.
Published: (2017)

Assigning Distinct Roles to Quantized and Low-Rank Matrices Toward Optimal Weight Decomposition
by: Cho, Yoonjun, et al.
Published: (2025)

Native Fortran Implementation of TensorFlow-Trained Deep and Bayesian Neural Networks
by: Furlong, Aidan, et al.
Published: (2025)

MODE: Efficient Time Series Prediction with Mamba Enhanced by Low-Rank Neural ODEs
by: Chen, Xingsheng, et al.
Published: (2026)

Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters
by: Wang, Xinjue, et al.
Published: (2026)

Enhancing Trustworthiness of Graph Neural Networks with Rank-Based Conformal Training
by: Wang, Ting, et al.
Published: (2025)

MoE-I$^2$: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition
by: Yang, Cheng, et al.
Published: (2024)

Unveiling Options with Neural Decomposition
by: Alikhasi, Mahdi, et al.
Published: (2024)

HDNet: Physics-Inspired Neural Network for Flow Estimation based on Helmholtz Decomposition
by: Qi, Miao, et al.
Published: (2024)

EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition
by: Nasiri, Hamid, et al.
Published: (2025)

Training Neural Networks from Scratch with Parallel Low-Rank Adapters
by: Huh, Minyoung, et al.
Published: (2024)

Survey on Generalization Theory for Graph Neural Networks
by: Vasileiou, Antonis, et al.
Published: (2025)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
by: Yang, Yifan, et al.
Published: (2024)

Low-Rank Compression of Language Models via Differentiable Rank Selection
by: Sundrani, Sidhant, et al.
Published: (2025)