Cover Image

Serving Large Language Models on Huawei CloudMatrix384

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zuo, Pengfei, Lin, Huimin, Deng, Junbo, Zou, Nan, Yang, Xingkun, Diao, Yingyu, Gao, Weifeng, Xu, Ke, Chen, Zhangyu, Lu, Shirui, Qiu, Zhao, Li, Peiyang, Chang, Xianyu, Yu, Zhengzhong, Miao, Fangzheng, Zheng, Jia, Li, Ying, Feng, Yuan, Wang, Bei, Zong, Zaijian, Zhou, Mosong, Zhou, Wenli, Chen, Houjiang, Liao, Xingyu, Li, Yipeng, Zhang, Wenxiao, Zhu, Ping, Wang, Yinggang, Xiao, Chuanjie, Liang, Depeng, Cao, Dong, Liu, Juncheng, Yang, Yongqiang, Bai, Xiaolong, Li, Yi, Xie, Huaguo, Wu, Huatao, Yu, Zhibin, Chen, Lv, Liu, Hu, Ding, Yujun, Zhu, Haipei, Xia, Jing, Xiong, Yi, Yu, Zhou, Liao, Heng
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing Artificial Intelligence Hardware Architecture Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Huawei Cloud Model-as-a-Service on the CloudMatrix384 SuperPod
by: Xiao, Ao, et al.
Published: (2025)

Research Progress on Pharmacological Effects and Mechanism of Polygonatum sibiricum Polysaccharides
by: Maohui Yang, et al.
Published: (2024)

Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation
by: Liang, Yunkai, et al.
Published: (2025)

Suppression of discontinuous precipitation by Fe addition in Cu–Ti alloys
by: Xu Wang, et al.
Published: (2024)

RMGAP: Benchmarking the Generalization of Reward Models across Diverse Preferences
by: Zhou, Yangyang, et al.
Published: (2026)

Active Honeypot Guardrail System: Probing and Confirming Multi-Turn LLM Jailbreaks
by: Wu, ChenYu, et al.
Published: (2025)

Implicit Semantic Communication Based on Bayesian Reconstruction Framework
by: Liao, Yiwei, et al.
Published: (2025)

Effect of Scoparia dulcis Extract on Lipid Oxidation in Fish Feed, Growth Performance, and Hypoxia Tolerance in Juvenile Jian Carp (Cyprinus carpio var. Jian)
by: Gangfu Chen, et al.
Published: (2024)

Transformer-Based Dual-Optical Attention Fusion Crowd Head Point Counting and Localization Network
by: Zhou, Fei, et al.
Published: (2025)

Leverage Knowledge Graph and Large Language Model for Law Article Recommendation: A Case Study of Chinese Criminal Law
by: Chen, Yongming, et al.
Published: (2024)

Opportunistic Screening of Upper Gastrointestinal Tumors in Rural Areas of Jining During 2023
by: Qing-Qing Yu, et al.
Published: (2026)

Photo‐induced proton release of spiropyran‐derived nanomaterials for mRNA delivery in hard‐to‐transfect cells
by: Caiwei Lu, et al.
Published: (2026)

Triglyceride‐Related Indices and Risk of Acute Pancreatitis: A Prospective Study in UK Biobank
by: Jing‐Bo Li, et al.
Published: (2026)

Preparation and Physicochemical Properties of Gynura divaricata (L.) DC Polysaccharides and Their Regulating Activities on Human Gut Microbiota
by: Si‐Jia Yu, et al.
Published: (2025)

Pharmacokinetics and tissue residues of albendazole sulphoxide and its metabolites in donkey after intramuscular injection
by: Zaijian Li, et al.
Published: (2024)

Characterization of Gold Nanoparticles Synthesized with Zingiber zerumbet Extracts
by: Wayne C. Liao, et al.
Published: (2024)

DualMap: Enabling Both Cache Affinity and Load Balancing for Distributed LLM Serving
by: Yuan, Ying, et al.
Published: (2026)

The Unique Citing Documents Journal Impact Factor (Uniq-JIF) as a Supplement for the standard Journal Impact Factor
by: Shen, Zhesi, et al.
Published: (2024)

Is Journal Citation Indicator a good metric for Art & Humanities Journals currently?
by: Liao, Yu, et al.
Published: (2025)

IMC-Net: A Lightweight Content-Conditioned Encoder with Multi-Pass Processing for Image Classification
by: Li, YiZhou
Published: (2025)

Unified Analytical Framework for SPAD Array Receivers with Dead-Time-Induced Blocking Loss and Inter-Symbol Interference in PAM-OWC Systems
by: Wang, Chen, et al.
Published: (2026)

Automatic Attenuation Control for Mitigating Photon-Counting Saturation in SPAD-based Optical Wireless Communications
by: Wang, Chen, et al.
Published: (2026)

Zirconia Minimizes Myeloid Innate Immunity as Dental Implants: An In Silico and In Vivo Study
by: Li‐Tzu Wang, et al.
Published: (2025)

Classification of Schmidt-rank-two multipartite unitary gates by singular number
by: Shen, Yi, et al.
Published: (2022)

Breaking the Context Bottleneck on Long Time Series Forecasting
by: Ma, Chao, et al.
Published: (2024)

Oxygen Reduction Activity Enhancement of Solid Oxide Fuel Cell Cathode via a Tiny Amount of Ni Doping
by: Depeng Zeng, et al.
Published: (2025)

Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers
by: Qin, Libo, et al.
Published: (2024)

Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN
by: Zhou, Zhilun, et al.
Published: (2024)

Character Mixing for Video Generation
by: Liao, Tingting, et al.
Published: (2025)

Harmonic Cancellation in Multi-Electrolyzer P2H Plants via Phasor-Modulated Production Scheduling
by: Zeng, Yangjun, et al.
Published: (2025)

SMRU: Split-and-Merge Recurrent-based UNet for Acoustic Echo Cancellation and Noise Suppression
by: Sun, Zhihang, et al.
Published: (2024)

Band Gap Engineering of Nitrogen-Doped Monolayer WSe$_2$ Superlattice and its application to Field Effect Transistor
by: Lo, Yi-Cheng, et al.
Published: (2025)

MSSFC-Net:Enhancing Building Interpretation with Multi-Scale Spatial-Spectral Feature Collaboration
by: Huo, Dehua, et al.
Published: (2025)

AgentExpt: Automating AI Experiment Design with LLM-based Resource Retrieval Agent
by: Li, Yu, et al.
Published: (2025)

CompressedMediQ: Hybrid Quantum Machine Learning Pipeline for High-Dimensional Neuroimaging Data
by: Chen, Kuan-Cheng, et al.
Published: (2024)

Applications of Large Scale Foundation Models for Autonomous Driving
by: Huang, Yu, et al.
Published: (2023)

Enhanced Hydrogen Electrolyzer with Integrated Energy Storage to Provide Grid-Forming Services for Off-Grid ReP2H Application
by: Qiu, Yiwei, et al.
Published: (2026)

Cachemir: Fully Homomorphic Encrypted Inference of Generative Large Language Model with KV Cache
by: Yu, Ye, et al.
Published: (2026)

Sparse linear array synthesis using artificial neural network and nonconvex optimization
by: Hanyu Li, et al.
Published: (2024)

Prefill-Decode Aggregation or Disaggregation? Unifying Both for Goodput-Optimized LLM Serving
by: Wang, Chao, et al.
Published: (2025)