Spark Transformer: Reactivating Sparsity in FFN and Attention

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	You, Chong, Wu, Kan, Jia, Zhipeng, Chen, Lin, Bhojanapalli, Srinadh, Guo, Jiaxian, Evci, Utku, Wassenberg, Jan, Netrapalli, Praneeth, Willcock, Jeremiah J., Subramanian, Suvinay, Chern, Felix, Andreev, Alek, Pathak, Shreya, Yu, Felix, Jain, Prateek, Culler, David E., Levy, Henry M., Kumar, Sanjiv
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2506.06644