AnchorTP: Resilient LLM Inference with State-Preserving Elastic Tensor Parallelism

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Wendong, Chen, Chujie, Xiao, He, Li, Kuan, Xiong, Jing, Zhang, Chen, Zhou, Wenyong, Tao, Chaofan, Bai, Yang, Yu, Bei, Wong, Ngai
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!