Rethinking RoPE Scaling in Quantized LLM: Theory, Outlier, and Channel-Band Analysis with Weight Rescaling

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Qiao, Ye, Xu, Haocheng, Zhang, Xiaofan, Huang, Sitao
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2510.00028