Low-Rank Learning by Design: the Role of Network Architecture and Activation Linearity in Gradient Rank Collapse

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Baker, Bradley T., Pearlmutter, Barak A., Miller, Robyn, Calhoun, Vince D., Plis, Sergey M.
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2402.06751