Cover Image

Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shenouda, Joseph, Parhi, Rahul, Lee, Kangwook, Nowak, Robert D.
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Effects of Multi-Task Learning on ReLU Neural Network Functions
by: Nakhleh, Julia, et al.
Published: (2024)

ReLUs Are Sufficient for Learning Implicit Neural Representations
by: Shenouda, Joseph, et al.
Published: (2024)

Function-Space Optimality of Neural Architectures with Multivariate Nonlinearities
by: Parhi, Rahul, et al.
Published: (2023)

Task Vectors in In-Context Learning: Emergence, Formation, and Benefit
by: Yang, Liu, et al.
Published: (2025)

Active Learning with Neural Networks: Insights from Nonparametric Statistics
by: Zhu, Yinglun, et al.
Published: (2022)

A Gap Between the Gaussian RKHS and Neural Networks: An Infinite-Center Asymptotic Analysis
by: Kumar, Akash, et al.
Published: (2025)

Stable Minima of ReLU Neural Networks Suffer from the Curse of Dimensionality: The Neural Shattering Phenomenon
by: Liang, Tongtong, et al.
Published: (2025)

Looped Transformers are Better at Learning Learning Algorithms
by: Yang, Liu, et al.
Published: (2023)

Random ReLU Neural Networks as Non-Gaussian Processes
by: Parhi, Rahul, et al.
Published: (2024)

Neural Network Compression for Reinforcement Learning Tasks
by: Ivanov, Dmitry A., et al.
Published: (2024)

Weighted variation spaces and approximation by shallow ReLU networks
by: DeVore, Ronald, et al.
Published: (2023)

Variational Inference on the Final-Layer Output of Neural Networks
by: Wei, Yadi, et al.
Published: (2023)

Topological Feature Compression for Molecular Graph Neural Networks
by: Khorana, Rahul
Published: (2025)

On the Loss Landscape Geometry of Regularized Deep Matrix Factorization: Uniqueness and Sharpness
by: Kamber, Anil, et al.
Published: (2026)

Sharpness of Minima in Deep Matrix Factorization
by: Kamber, Anil, et al.
Published: (2025)

Global Minimizers of $\ell^p$-Regularized Objectives Yield the Sparsest ReLU Neural Networks
by: Nakhleh, Julia, et al.
Published: (2025)

Dual Operating Modes of In-Context Learning
by: Lin, Ziqian, et al.
Published: (2024)

Finding Stable Subnetworks at Initialization with Dataset Distillation
by: McDermott, Luke, et al.
Published: (2025)

Does Sparse Connectivity Improve Generalization? Convolutional Networks Below the Edge of Stability
by: Liang, Tongtong, et al.
Published: (2026)

Optimal Recovery Meets Minimax Estimation
by: DeVore, Ronald, et al.
Published: (2025)

Modeling Output-Level Task Relatedness in Multi-Task Learning with Feedback Mechanism
by: Xi, Xiangming, et al.
Published: (2024)

Nonasymptotic Convergence Rates for Plug-and-Play Methods With MMSE Denoisers
by: Pritchard, Henry, et al.
Published: (2025)

Memorization Capacity for Additive Fine-Tuning with Small ReLU Networks
by: Sohn, Jy-yong, et al.
Published: (2024)

Towards Sharp Minimax Risk Bounds for Operator Learning
by: Adcock, Ben, et al.
Published: (2025)

Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks
by: Collins, Liam, et al.
Published: (2023)

Multi-Task Corrupted Prediction for Learning Robust Audio-Visual Speech Representation
by: Kim, Sungnyun, et al.
Published: (2025)

Compressing Neural Networks Using Tensor Networks with Exponentially Fewer Variational Parameters
by: Qing, Yong, et al.
Published: (2023)

Derivation of Output Correlation Inferences for Multi-Output (aka Multi-Task) Gaussian Process
by: Watanabe, Shuhei
Published: (2025)

Improving Graph Neural Networks on Multi-node Tasks with the Labeling Trick
by: Wang, Xiyuan, et al.
Published: (2023)

Federated Multi Agent Deep Learning and Neural Networks for Advanced Distributed Sensing in Wireless Networks
by: Muller, Nadine, et al.
Published: (2026)

SpinMultiNet: Neural Network Potential Incorporating Spin Degrees of Freedom with Multi-Task Learning
by: Ueno, Koki, et al.
Published: (2024)

LayerPipe2: Multistage Pipelining and Weight Recompute via Improved Exponential Moving Average for Training Neural Networks
by: Unnikrishnan, Nanda K., et al.
Published: (2025)

Neural Embedding Compression For Efficient Multi-Task Earth Observation Modelling
by: Gomes, Carlos, et al.
Published: (2024)

Scalable Multi-Output Gaussian Processes with Stochastic Variational Inference
by: Jiang, Xiaoyu, et al.
Published: (2024)

Optimizing DDPM Sampling with Shortcut Fine-Tuning
by: Fan, Ying, et al.
Published: (2023)

Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks
by: Park, Jongho, et al.
Published: (2024)

Variational Neural Networks
by: Oleksiienko, Illia, et al.
Published: (2022)

AMORE: Adaptive Multi-Output Operator Network for Stiff Chemical Kinetics
by: Nath, Kamaljyoti, et al.
Published: (2025)

In-Context Learning with Hypothesis-Class Guidance
by: Lin, Ziqian, et al.
Published: (2025)

LoLA: Low-Rank Linear Attention With Sparse Caching
by: McDermott, Luke, et al.
Published: (2025)