Copertina

TPI-LLM: Serving 70B-scale LLMs Efficiently on Low-resource Edge Devices

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Li, Zonghang, Feng, Wenjiao, Guizani, Mohsen, Yu, Hongfang
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Distributed, Parallel, and Cluster Computing Artificial Intelligence 68T50 I.2.11
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Prima.cpp: Fast 30-70B LLM Inference on Heterogeneous and Low-Resource Home Clusters
di: Li, Zonghang, et al.
Pubblicazione: (2025)

Learning In Chaos: Efficient Autoscaling and Self-Healing for Multi-Party Distributed Training
di: Feng, Wenjiao, et al.
Pubblicazione: (2025)

Accelerating Geo-distributed Machine Learning with Network-Aware Adaptive Tree and Auxiliary Route
di: Li, Zonghang, et al.
Pubblicazione: (2024)

Serial Parallel Reliability Redundancy Allocation Optimization for Energy Efficient and Fault Tolerant Cloud Computing
di: Krishna, Gutha Jaya
Pubblicazione: (2024)

SI-ChainFL: Shapley-Incentivized Secure Federated Learning for High-Speed Rail Data Sharing
di: Zhao, Mingjie, et al.
Pubblicazione: (2026)

Roadmap for Edge AI: A Dagstuhl Perspective
di: Ding, Aaron Yi, et al.
Pubblicazione: (2021)

SPARK: Igniting Communication-Efficient Decentralized Learning via Stage-wise Projected NTK and Accelerated Regularization
di: Xia, Li
Pubblicazione: (2025)

EPARA: Parallelizing Categorized AI Inference in Edge Clouds
di: Wang, Yubo, et al.
Pubblicazione: (2025)

Uncertainty Estimation in Multi-Agent Distributed Learning for AI-Enabled Edge Devices
di: Radchenko, Gleb, et al.
Pubblicazione: (2024)

CodeCRDT: Observation-Driven Coordination for Multi-Agent LLM Code Generation
di: Pugachev, Sergey
Pubblicazione: (2025)

TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications
di: Bian, Zhuohang, et al.
Pubblicazione: (2025)

Aergia: Leveraging Heterogeneity in Federated Learning Systems
di: Cox, Bart, et al.
Pubblicazione: (2022)

Towards Optimal Heterogeneous Client Sampling in Multi-Model Federated Learning
di: Zhang, Haoran, et al.
Pubblicazione: (2025)

Parameterizing Federated Continual Learning for Reproducible Research
di: Cox, Bart, et al.
Pubblicazione: (2024)

Asynchronous Byzantine Federated Learning
di: Cox, Bart, et al.
Pubblicazione: (2024)

Hyper-parameter Optimization for Federated Learning with Step-wise Adaptive Mechanism
di: Saadati, Yasaman, et al.
Pubblicazione: (2024)

Training Diffusion Models with Federated Learning
di: de Goede, Matthijs, et al.
Pubblicazione: (2024)

Connecting Large Language Model Agent to High Performance Computing Resource
di: Ma, Heng, et al.
Pubblicazione: (2025)

Quantize Once, Train Fast: Allreduce-Compatible Compression with Provable Guarantees
di: Xin, Jihao, et al.
Pubblicazione: (2023)

Comparison of Autoscaling Frameworks for Containerised Machine-Learning-Applications in a Local and Cloud Environment
di: Schroeder, Christian, et al.
Pubblicazione: (2023)

Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients
di: Zuo, Yuncong, et al.
Pubblicazione: (2024)

AMP4EC: Adaptive Model Partitioning Framework for Efficient Deep Learning Inference in Edge Computing Environments
di: Zhang, Guilin, et al.
Pubblicazione: (2025)

Edge AI Collaborative Learning: Bayesian Approaches to Uncertainty Estimation
di: Radchenko, Gleb, et al.
Pubblicazione: (2024)

ADF-LoRA: Alternating Low-Rank Aggregation for Decentralized Federated Fine-Tuning
di: Wang, Xiaoyu, et al.
Pubblicazione: (2025)

Separating Intelligence from Execution: A Workflow Engine for the Model Context Protocol
di: Parmar, Abhinav Singh
Pubblicazione: (2026)

WLB-LLM: Workload-Balanced 4D Parallelism for Large Language Model Training
di: Wang, Zheng, et al.
Pubblicazione: (2025)

SparkAttention: High-Performance Multi-Head Attention for Large Models on Volta GPU Architecture
di: Xu, Youxuan, et al.
Pubblicazione: (2025)

AutoDDL: Automatic Distributed Deep Learning with Near-Optimal Bandwidth Cost
di: Chen, Jinfan, et al.
Pubblicazione: (2023)

How Machine Learning-Data Driven Replication Strategies Enhance Fault Tolerance in Large-Scale Distributed Systems
di: Murimi, Almond Kiruthu
Pubblicazione: (2025)

FedPLT: Scalable, Resource-Efficient, and Heterogeneity-Aware Federated Learning via Partial Layer Training
di: Dabaja, Ahmad, et al.
Pubblicazione: (2026)

Securing Federated Sensitive Topic Classification against Poisoning Attacks
di: Chu, Tianyue, et al.
Pubblicazione: (2022)

Bridging Generalization Gap of Heterogeneous Federated Clients Using Generative Models
di: Niu, Ziru, et al.
Pubblicazione: (2025)

Combinatorial Client-Master Multiagent Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing
di: Gebrekidan, Tesfay Zemuy, et al.
Pubblicazione: (2024)

DAGER: Exact Gradient Inversion for Large Language Models
di: Petrov, Ivo, et al.
Pubblicazione: (2024)

LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management
di: Xiong, Yi, et al.
Pubblicazione: (2024)

Federated Learning for Anomaly Detection in Energy Consumption Data: Assessing the Vulnerability to Adversarial Attacks
di: Telila, Yohannis Kifle, et al.
Pubblicazione: (2025)

HeteroTune: Efficient Federated Learning for Large Heterogeneous Models
di: Jia, Ruofan, et al.
Pubblicazione: (2024)

Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines
di: Li, Shigang, et al.
Pubblicazione: (2021)

SPEAR++: Scaling Gradient Inversion via Sparsely-Used Dictionary Learning
di: Bakarsky, Alexander, et al.
Pubblicazione: (2025)

A Full Compression Pipeline for Green Federated Learning in Communication-Constrained Environments
di: Colybes, Elouan, et al.
Pubblicazione: (2026)