Why Can't Transformers Learn Multiplication? Reverse-Engineering Reveals Long-Range Dependency Pitfalls

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bai, Xiaoyan, Pres, Itamar, Deng, Yuntian, Tan, Chenhao, Shieber, Stuart, Viégas, Fernanda, Wattenberg, Martin, Lee, Andrew
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2510.00184