Image de couverture de livre

A Parallel Alternative for Energy-Efficient Neural Network Training and Inferencing

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Seal, Sudip K., Alam, Maksudul, Ramirez, Jorge, Dash, Sajal, Lu, Hao
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Piper: Efficient Large-Scale MoE Training via Resource Modeling and Pipelined Hybrid Parallelism
par: Dash, Sajal, et autres
Publié: (2026)

An Active Learning-Based Streaming Pipeline for Reduced Data Training of Structure Finding Models in Neutron Diffractometry
par: Wang, Tianle, et autres
Publié: (2025)

Scalable Artificial Intelligence for Science: Perspectives, Methods and Exemplars
par: Brewer, Wesley, et autres
Publié: (2024)

Semantic Parallelism: Redefining Efficient MoE Inference via Model-Data Co-Scheduling
par: Li, Yan, et autres
Publié: (2025)

EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism
par: Chen, Yanxi, et autres
Publié: (2023)

Context Parallelism for Scalable Million-Token Inference
par: Yang, Amy, et autres
Publié: (2024)

TAPAS: Fast and Automatic Derivation of Tensor Parallel Strategies for Large Neural Networks
par: Shi, Ziji, et autres
Publié: (2023)

FedFiTS: Fitness-Selected, Slotted Client Scheduling for Trustworthy Federated Learning in Healthcare AI
par: Kahenga, Ferdinand, et autres
Publié: (2025)

FedFusion: Federated Learning with Diversity- and Cluster-Aware Encoders for Robust Adaptation under Label Scarcity
par: Kahenga, Ferdinand, et autres
Publié: (2025)

TACO: Efficient Communication Compression of Intermediate Tensors for Scalable Tensor-Parallel LLM Training
par: Liu, Man, et autres
Publié: (2026)

Parallel-in-Time Training of Recurrent Neural Networks for Dynamical Systems Reconstruction
par: Hess, Florian, et autres
Publié: (2026)

Online Parallel Multi-Task Relationship Learning via Alternating Direction Method of Multipliers
par: Li, Ruiyu, et autres
Publié: (2024)

Efficient MoE Inference with Fine-Grained Scheduling of Disaggregated Expert Parallelism
par: Pan, Xinglin, et autres
Publié: (2025)

SPECTRE: Hybrid Ordinary-Parallel Speculative Serving for Resource-Efficient LLM Inference
par: Xie, Jincheng, et autres
Publié: (2026)

Cyclic Data Parallelism for Efficient Parallelism of Deep Neural Networks
par: Fournier, Louis, et autres
Publié: (2024)

Tackling Selfish Clients in Federated Learning
par: Augello, Andrea, et autres
Publié: (2024)

Plexus: Taming Billion-edge Graphs with 3D Parallel Full-graph GNN Training
par: Ranjan, Aditya K., et autres
Publié: (2025)

Scalable and Adaptive Parallel Training of Graph Transformer on Large Graphs
par: Lin, Jun-Liang, et autres
Publié: (2026)

Sampling Parallelism for Fast and Efficient Bayesian Learning
par: Özdemir, Asena Karolin, et autres
Publié: (2026)

MoESys: A Distributed and Efficient Mixture-of-Experts Training and Inference System for Internet Services
par: Yu, Dianhai, et autres
Publié: (2022)

Communication-free Sampling and 4D Hybrid Parallelism for Scalable Mini-batch GNN Training
par: Wei, Cunyang, et autres
Publié: (2026)

Efficient Training on Multiple Consumer GPUs with RoundPipe
par: Luo, Yibin, et autres
Publié: (2026)

Distributed Graph Neural Network Inference With Just-In-Time Compilation For Industry-Scale Graphs
par: Wu, Xiabao, et autres
Publié: (2025)

DistrEE: Distributed Early Exit of Deep Neural Network Inference on Edge Devices
par: Peng, Xian, et autres
Publié: (2025)

Semi-decentralized Training of Spatio-Temporal Graph Neural Networks for Traffic Prediction
par: Kralj, Ivan, et autres
Publié: (2024)

InfiniPipe: Elastic Pipeline Parallelism for Efficient Variable-Length Long-Context LLM Training
par: Wang, Shiju, et autres
Publié: (2025)

Mist: Efficient Distributed Training of Large Language Models via Memory-Parallelism Co-Optimization
par: Zhu, Zhanda, et autres
Publié: (2025)

GraphPipe: Improving Performance and Scalability of DNN Training with Graph Pipeline Parallelism
par: Jeon, Byungsoo, et autres
Publié: (2024)

BitPipe: Bidirectional Interleaved Pipeline Parallelism for Accelerating Large Models Training
par: Wu, Houming, et autres
Publié: (2024)

Opara: Exploiting Operator Parallelism for Expediting DNN Inference on GPUs
par: Chen, Aodong, et autres
Publié: (2023)

Training Through Failure: Effects of Data Consistency in Parallel Machine Learning Training
par: Cao, Ray, et autres
Publié: (2024)

A 4D Hybrid Algorithm to Scale Parallel Training to Thousands of GPUs
par: Singh, Siddharth, et autres
Publié: (2023)

SPD: Sync-Point Drop for Efficient Tensor Parallelism of Large Language Models
par: Kim, Han-Byul, et autres
Publié: (2025)

Collaborative Split Federated Learning with Parallel Training and Aggregation
par: Papageorgiou, Yiannis, et autres
Publié: (2025)

TawPipe: Topology-Aware Weight Pipeline Parallelism for Accelerating Long-Context Large Models Training
par: Wu, Houming, et autres
Publié: (2025)

Efficient Onboard Vision-Language Inference in UAV-Enabled Low-Altitude Economy Networks via LLM-Enhanced Optimization
par: Li, Yang, et autres
Publié: (2025)

PIPO: Pipelined Offloading for Efficient Inference on Consumer Devices
par: Liu, Yangyijian, et autres
Publié: (2025)

DisagMoE: Computation-Communication overlapped MoE Training via Disaggregated AF-Pipe Parallelism
par: Zeng, Zhichen, et autres
Publié: (2026)

xDiT: an Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism
par: Fang, Jiarui, et autres
Publié: (2024)

DWDP: Distributed Weight Data Parallelism for High-Performance LLM Inference on NVL72
par: Li, Wanqian, et autres
Publié: (2026)