Softplus Attention with Re-weighting Boosts Length Extrapolation in Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gao, Bo, Spratling, Michael W., Gionfrida, Letizia
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!