Image de couverture de livre

DeInfer: Efficient Parallel Inferencing for Decomposed Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Huang, You-Liang, Huang, Xinhao, Liao, Chengxi, Wen, Zeyi
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

InferCept: Efficient Intercept Support for Augmented Large Language Model Inference
par: Abhyankar, Reyna, et autres
Publié: (2024)

SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification
par: Miao, Xupeng, et autres
Publié: (2023)

Quasar: Quantized Self-Speculative Acceleration for Rapid Inference via Memory-Efficient Verification
par: Huang, Guang, et autres
Publié: (2026)

Folding Tensor and Sequence Parallelism for Memory-Efficient Transformer Training & Inference
par: Shyam, Vasu, et autres
Publié: (2026)

Inference Acceleration for Large Language Models on CPUs
par: PS, Ditto, et autres
Publié: (2024)

BlockBPE: Parallel BPE Tokenization
par: You, Amos
Publié: (2025)

LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models
par: Park, Gunho, et autres
Publié: (2022)

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding
par: Chen, Qiaoling, et autres
Publié: (2024)

SLO-Aware Scheduling for Large Language Model Inferences
par: Huang, Jinqi, et autres
Publié: (2025)

HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices
par: Zhao, Xuanlei, et autres
Publié: (2024)

A Federated and Parameter-Efficient Framework for Large Language Model Training in Medicine
par: Li, Anran, et autres
Publié: (2026)

Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution
par: Wang, Siqi, et autres
Publié: (2024)

Decouple and Decompose: Scaling Resource Allocation with DeDe
par: Xu, Zhiying, et autres
Publié: (2024)

HydraInfer: Hybrid Disaggregated Scheduling for Multimodal Large Language Model Serving
par: Dong, Xianzhe, et autres
Publié: (2025)

PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
par: Butler, Branden, et autres
Publié: (2024)

Enhancing Memory Efficiency in Large Language Model Training Through Chronos-aware Pipeline Parallelism
par: Lin, Xinyuan, et autres
Publié: (2025)

Energy-Efficient Split Learning for Fine-Tuning Large Language Models in Edge Networks
par: Li, Zuguang, et autres
Publié: (2024)

CkIO: Parallel File Input for Over-Decomposed Task-Based Systems
par: Jacob, Mathew, et autres
Publié: (2024)

HAP: Hybrid Adaptive Parallelism for Efficient Mixture-of-Experts Inference
par: Lin, Haoran, et autres
Publié: (2025)

EPS-MoE: Expert Pipeline Scheduler for Cost-Efficient MoE Inference
par: Qian, Yulei, et autres
Publié: (2024)

Conveyor: Efficient Tool-aware LLM Serving with Tool Partial Execution
par: Xu, Yechen, et autres
Publié: (2024)

Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training
par: Sun, Ao, et autres
Publié: (2024)

SiDP: Memory-Efficient Data Parallelism for Offline LLM Inference
par: Zhao, Alan, et autres
Publié: (2026)

An Efficient Heterogeneous Co-Design for Fine-Tuning on a Single GPU
par: Yang, Ruijia, et autres
Publié: (2026)

Ghidorah: Fast LLM Inference on Edge with Speculative Decoding and Hetero-Core Parallelism
par: Wei, Jinhui, et autres
Publié: (2025)

SPECTRE: Hybrid Ordinary-Parallel Speculative Serving for Resource-Efficient LLM Inference
par: Xie, Jincheng, et autres
Publié: (2026)

FLYING SERVING: On-the-Fly Parallelism Switching for Large Language Model Serving
par: Gao, Shouwei, et autres
Publié: (2026)

Collaborative Inference for Large Models with Task Offloading and Early Exiting
par: Xie, Zuan, et autres
Publié: (2024)

CFP: Efficient Optimization of Intra-Operator Parallelism Plans for Large Model Training
par: Hu, Weifang, et autres
Publié: (2025)

Hybrid-Parallel: Achieving High Performance and Energy Efficient Distributed Inference on Robots
par: Sun, Zekai, et autres
Publié: (2024)

FlexLLM: Token-Level Co-Serving of LLM Inference and Finetuning with SLO Guarantees
par: Oliaro, Gabriele, et autres
Publié: (2024)

Split Fine-Tuning for Large Language Models in Wireless Networks
par: Zhang, Songge, et autres
Publié: (2025)

LLMTailor: A Layer-wise Tailoring Tool for Efficient Checkpointing of Large Language Models
par: Sun, Minqiu, et autres
Publié: (2026)

AGoQ: Activation and Gradient Quantization for Memory-Efficient Distributed Training of LLMs
par: Lin, Wenxiang, et autres
Publié: (2026)

Extending Contract Verification for Parallel Programming Models to Fortran
par: Oraji, Yussur Mustafa, et autres
Publié: (2026)

Communication-Efficient Collaborative LLM Inference over LEO Satellite Networks
par: Zhang, Songge, et autres
Publié: (2026)

EPIC: Efficient Position-Independent Caching for Serving Large Language Models
par: Hu, Junhao, et autres
Publié: (2024)

Verifying Properties of Index Arrays in a Purely-Functional Data-Parallel Language
par: Hinnerskov, Nikolaj Hey, et autres
Publié: (2025)

Distributed Speculative Inference (DSI): Speculation Parallelism for Provably Faster Lossless Language Model Inference
par: Timor, Nadav, et autres
Publié: (2024)

Efficient Parallel Compilation and Profiling of Quantum Circuits at Large Scales
par: Moore, Jane, et autres
Publié: (2026)