Image de couverture de livre

HyperParallel: A Supernode-Affinity AI Framework

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Xin, Sun, Beilei, Su, Teng, Zhang, Qinghua, Bao, Chong, Chen, Lei, Jin, Xuefeng
Format:	Preprint
Publié:	2026
Sujets:	Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

HyperOffload: Graph-Driven Hierarchical Memory Management for Large Language Models on SuperNode Architectures
par: Liu, Fangxin, et autres
Publié: (2026)

ICPS: Real-Time Resource Configuration for Cloud Serverless Functions Considering Affinity
par: Chen, Long, et autres
Publié: (2025)

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding
par: Chen, Qiaoling, et autres
Publié: (2024)

Amoeba: Runtime Tensor Parallel Transformation for LLM Inference Services
par: Chen, Haoyu, et autres
Publié: (2025)

LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism
par: Gu, Diandian, et autres
Publié: (2024)

DawnPiper: A Memory-scablable Pipeline Parallel Training Framework
par: Peng, Xuan, et autres
Publié: (2025)

ZeroPP: Unleashing Exceptional Parallelism Efficiency through Tensor-Parallelism-Free Methodology
par: Tang, Ding, et autres
Publié: (2024)

Affinity-aware Serverless Function Scheduling
par: De Palma, Giuseppe, et autres
Publié: (2024)

KCES: A Workflow Containerization Scheduling Scheme Under Cloud-Edge Collaboration Framework
par: Shan, Chenggang, et autres
Publié: (2024)

MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in Production
par: Xue, Chunyu, et autres
Publié: (2026)

SPPO:Efficient Long-sequence LLM Training via Adaptive Sequence Pipeline Parallel Offloading
par: Chen, Qiaoling, et autres
Publié: (2025)

HAP: Hybrid Adaptive Parallelism for Efficient Mixture-of-Experts Inference
par: Lin, Haoran, et autres
Publié: (2025)

Surviving Partial Rank Failures in Wide Expert-Parallel MoE Inference
par: Sun, Xun, et autres
Publié: (2026)

SeaLLM: Service-Aware and Latency-Optimized Resource Sharing for Large Language Model Inference
par: Zhao, Yihao, et autres
Publié: (2025)

NeutronTP: Load-Balanced Distributed Full-Graph GNN Training with Tensor Parallelism
par: Ai, Xin, et autres
Publié: (2024)

Resource-efficient Parallel Split Learning in Heterogeneous Edge Computing
par: Zhang, Mingjin, et autres
Publié: (2024)

DualMap: Enabling Both Cache Affinity and Load Balancing for Distributed LLM Serving
par: Yuan, Ying, et autres
Publié: (2026)

NanoCP: Request-Level Dynamic Context Parallelism for Data-Expert Parallel Decoding
par: Chen, Jiefei, et autres
Publié: (2026)

Communication-Computation Pipeline Parallel Split Learning over Wireless Edge Networks
par: Liu, Chenyu, et autres
Publié: (2025)

Resource Allocation in HyperX Networks
par: Cano, Alejandro, et autres
Publié: (2026)

Synergistic Tensor and Pipeline Parallelism
par: Qi, Mengshi, et autres
Publié: (2025)

Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training
par: Sun, Ao, et autres
Publié: (2024)

MoFa: A Unified Performance Modeling Framework for LLM Pretraining
par: Zhao, Lu, et autres
Publié: (2025)

Hecate: Unlocking Efficient Sparse Model Training via Fully Sharded Sparse Data Parallelism
par: Qing, Yuhao, et autres
Publié: (2025)

UniPar: A Unified LLM-Based Framework for Parallel and Accelerated Code Translation in HPC
par: Bitan, Tomer, et autres
Publié: (2025)

Heterogeneous Federated Fine-Tuning with Parallel One-Rank Adaptation
par: Zhang, Zikai, et autres
Publié: (2026)

A Flexible Programmable Pipeline Parallelism Framework for Efficient DNN Training
par: Jiang, Lijuan, et autres
Publié: (2025)

Communication-Efficient Serving for Video Diffusion Models with Latent Parallelism
par: Wu, Zhiyuan, et autres
Publié: (2025)

CFP: Efficient Optimization of Intra-Operator Parallelism Plans for Large Model Training
par: Hu, Weifang, et autres
Publié: (2025)

ElasWave: An Elastic-Native System for Scalable Hybrid-Parallel Training
par: Kang, Xueze, et autres
Publié: (2025)

FastSet: Parallel Claim Settlement
par: Chen, Xiaohong, et autres
Publié: (2025)

Power Aware Container Placement in Cloud Computing with Affinity and Cubic Power Model
par: Sarkar, Suvarthi, et autres
Publié: (2024)

Balancing Pipeline Parallelism with Vocabulary Parallelism
par: Yeung, Man Tsung, et autres
Publié: (2024)

Mapping Parallel Matrix Multiplication in GotoBLAS2 to the AMD Versal ACAP for Deep Learning
par: Lei, Jie, et autres
Publié: (2024)

Joint Temporal-Structural Representation Learning for Distributed Fault Discrimination in Microservice Architectures
par: Xue, Yihan, et autres
Publié: (2026)

TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference
par: Zhang, Hongbin, et autres
Publié: (2025)

Optimizing Long-context LLM Serving via Fine-grained Sequence Parallelism
par: Li, Cong, et autres
Publié: (2025)

Accelerating Microswimmer Simulations via a Heterogeneous Pipelined Parallel-in-Time Framework
par: Huang, Ruixiang, et autres
Publié: (2026)

Speeding up Local Optimization in Vehicle Routing with Tensor-based GPU Acceleration
par: Lei, Zhenyu, et autres
Publié: (2025)

gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling
par: Guo, Tianyu, et autres
Publié: (2025)