Linear attention is (maybe) all you need (to understand transformer optimization)

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ahn, Kwangjun, Cheng, Xiang, Song, Minhak, Yun, Chulhee, Jadbabaie, Ali, Sra, Suvrit
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!