Beyond Length: Quantifying Long-Range Information for Long-Context LLM Pretraining Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Deng, Haoran, Lin, Yingyu, Lin, Zhenghao, Liu, Xiao, Sun, Yizhou, Ma, Yi-An, Gong, Yeyun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!