Image de couverture de livre

Edge Intelligence Optimization for Large Language Model Inference with Batching and Quantization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Xinyuan, Liu, Jiang, Xiong, Zehui, Huang, Yudong, Xie, Gaochang, Zhang, Ran
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence Networking and Internet Architecture
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MoE$^2$: Optimizing Collaborative Inference for Edge Large Language Models
par: Jin, Lyudong, et autres
Publié: (2025)

LAMeTA: Intent-Aware Agentic Network Optimization via a Large AI Model-Empowered Two-Stage Approach
par: Liu, Yinqiu, et autres
Publié: (2025)

LAMBO: Large AI Model Empowered Edge Intelligence
par: Dong, Li, et autres
Publié: (2023)

Large Language Model (LLM)-enabled Reinforcement Learning for Wireless Network Optimization
par: Zheng, Jie, et autres
Publié: (2026)

Toward Agentic AI: Generative Information Retrieval Inspired Intelligent Communications and Networking
par: Zhang, Ruichen, et autres
Publié: (2025)

Large Language Models for Networking: Workflow, Advances and Challenges
par: Liu, Chang, et autres
Publié: (2024)

When Large Language Model Agents Meet 6G Networks: Perception, Grounding, and Alignment
par: Xu, Minrui, et autres
Publié: (2024)

Mobile Edge Intelligence for Large Language Models: A Contemporary Survey
par: Qu, Guanqiao, et autres
Publié: (2024)

Semantic Communications for Artificial Intelligence Generated Content (AIGC) Toward Effective Content Creation
par: Liu, Guangyuan, et autres
Publié: (2023)

Neural Quantile Optimization for Edge-Cloud Networking
par: Du, Bin, et autres
Publié: (2023)

Agentic AI Reasoning for Mobile Edge General Intelligence: Fundamentals, Approaches, and Directions
par: Luo, Mingyi, et autres
Publié: (2025)

CollaPipe: Adaptive Segment-Optimized Pipeline Parallelism for Collaborative LLM Training in Heterogeneous Edge Networks
par: Chen, Jiewei, et autres
Publié: (2025)

Large Language Models (LLMs) for Semantic Communication in Edge-based IoT Networks
par: Kalita, Alakesh
Publié: (2024)

Hallucination-aware Optimization for Large Language Model-empowered Communications
par: Liu, Yinqiu, et autres
Publié: (2024)

Towards Edge General Intelligence via Large Language Models: Opportunities and Challenges
par: Chen, Handi, et autres
Publié: (2024)

PartialLoading: User Scheduling and Bandwidth Allocation for Parameter-sharing Edge Inference
par: Qu, Guanqiao, et autres
Publié: (2025)

OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models
par: Liu, Yuhe, et autres
Publié: (2023)

Adaptive Contextual Caching for Mobile Edge Large Language Model Service
par: Liu, Guangyuan, et autres
Publié: (2025)

A Survey on Cloud-Edge-Terminal Collaborative Intelligence in AIoT Networks
par: Wu, Jiaqi, et autres
Publié: (2025)

Sensing and Understanding the World over Air: A Large Multimodal Model for Mobile Networks
par: Duan, Zhuoran, et autres
Publié: (2025)

TrimCaching: Parameter-sharing AI Model Caching in Wireless Edge Networks
par: Qu, Guanqiao, et autres
Publié: (2024)

Revisiting Outage for Edge Inference Systems
par: Wang, Zhanwei, et autres
Publié: (2025)

WirelessLLM: Empowering Large Language Models Towards Wireless Intelligence
par: Shao, Jiawei, et autres
Publié: (2024)

WirelessAgent: Large Language Model Agents for Intelligent Wireless Networks
par: Tong, Jingwen, et autres
Publié: (2024)

Embodied AI-Enhanced IoMT Edge Computing: UAV Trajectory Optimization and Task Offloading with Mobility Prediction
par: Mu, Siqi, et autres
Publié: (2025)

CoMoE: Collaborative Optimization of Expert Aggregation and Offloading for MoE-based LLMs at Edge
par: Li, Muqing, et autres
Publié: (2025)

Cached Model-as-a-Resource: Provisioning Large Language Model Agents for Edge Intelligence in Space-air-ground Integrated Networks
par: Xu, Minrui, et autres
Publié: (2024)

ChatTracer: Large Language Model Powered Real-time Bluetooth Device Tracking System
par: Wang, Qijun, et autres
Publié: (2024)

Beyond the Edge: An Advanced Exploration of Reinforcement Learning for Mobile Edge Computing, its Applications, and Future Research Trajectories
par: Yang, Ning, et autres
Publié: (2024)

Multi-attribute Auction-based Resource Allocation for Twins Migration in Vehicular Metaverses: A GPT-based DRL Approach
par: Tong, Yongju, et autres
Publié: (2024)

Intra-DP: A High Performance Collaborative Inference System for Mobile Edge Computing
par: Sun, Zekai, et autres
Publié: (2025)

Effective ML Model Versioning in Edge Networks
par: Gentzen, Fin, et autres
Publié: (2024)

Intelligent Detection and Mitigation of Carpet-Bombing DDoS Attacks in SDN Using Retrieval-Augmented Generation and Large Language Models
par: Swileh, Mohammed N., et autres
Publié: (2026)

Distributed Collaborative Inference System in Next-Generation Networks and Communication
par: Zhang, Chuan, et autres
Publié: (2024)

Optimizing Multi-Gateway LoRaWAN via Cloud-Edge Collaboration and Knowledge Distillation
par: Yang, Hong
Publié: (2025)

Large Language Models meet Network Slicing Management and Orchestration
par: Dandoush, Abdulhalim, et autres
Publié: (2024)

Intent-Based Network for RAN Management with Large Language Models
par: Bimo, Fransiscus Asisi, et autres
Publié: (2025)

Distilling Large Language Models for Network Active Queue Management
par: Pokhrel, Shiva Raj, et autres
Publié: (2025)

Constrained Network Slice Assignment via Large Language Models
par: Sudhakara, Sagar, et autres
Publié: (2025)

OFCnetLLM: Large Language Model for Network Monitoring and Alertness
par: Yoon, Hong-Jun, et autres
Publié: (2025)