CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Shiyi, Ye, Jing, Jiang, Wei, Xue, Siqiao, Zhang, Qi, Wu, Yifan, Li, Jianguo
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!