Imagen de Portada

Dynamic Model Routing and Cascading for Efficient LLM Inference: A Survey

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Moslem, Yasmin, Kelleher, John D.
Formato:	Preprint
Publicado:	2026
Materias:	Networking and Internet Architecture Computation and Language Performance
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Iterative Layer Pruning for Efficient Translation Inference
por: Moslem, Yasmin, et al.
Publicado: (2025)

SparKV: Overhead-Aware KV Cache Loading for Efficient On-Device LLM Inference
por: Liu, Hongyao, et al.
Publicado: (2026)

Preprocess your Paths -- Speeding up Linear Programming-based Optimization for Segment Routing Traffic Engineering
por: Brundiers, Alexander, et al.
Publicado: (2023)

Joint Network Slicing, Routing, and In-Network Computing for Energy-Efficient 6G
por: Sasan, Zeinab, et al.
Publicado: (2024)

Leveraging Uncertainty Estimation for Efficient LLM Routing
por: Zhang, Tuo, et al.
Publicado: (2025)

An Efficient Wireless iBCI Headstage with Adaptive ADC Sample Rate
por: Liu, Hongyao, et al.
Publicado: (2026)

On Efficient Topology Management in Service-Oriented 6G Networks: An Edge Video Distribution Case Study
por: Ennaceur, Zied, et al.
Publicado: (2024)

Third-Party Assessment of Mobile Performance in the 5G Era
por: Rizvi, ASM, et al.
Publicado: (2025)

RouteProfile: Graph-Based Profiling for Cold-Start LLM Routing
por: Xu, Jingjun, et al.
Publicado: (2026)

Network Calculus Bounds for Time-Sensitive Networks: A Revisit
por: Jiang, Yuming
Publicado: (2024)

DTN-COMET: A Comprehensive Operational Metrics Evaluation Toolkit for DTN
por: Nöthlich, Tobias, et al.
Publicado: (2025)

A protocol to reduce worst-case latency in deflection-based on-chip networks
por: Indrusiak, Leandro Soares
Publicado: (2025)

Starlink on the Road: A First Look at Mobile Starlink Performance in Central Europe
por: Laniewski, Dominic, et al.
Publicado: (2024)

A Stochastic Geometry Based Techno-Economic Analysis of RIS-Assisted Cellular Networks
por: Sun, Guodong, et al.
Publicado: (2025)

Large-Scale Measurement of NAT Traversal for the Decentralized Web: A Case Study of DCUtR in IPFS
por: Trautwein, Dennis, et al.
Publicado: (2026)

Evaluating the Efficacy of Next.js: A Comparative Analysis with React.js on Performance, SEO, and Global Network Equity
por: Pati, Swostik, et al.
Publicado: (2025)

A Power-Consumption Analysis for Different IPoWDM Network Architectures with ZR/ZR+ and Long-Haul Muxponders
por: Zhang, Qiaolun, et al.
Publicado: (2024)

A lightweight Outlier Detection for Characterizing Radio- and Environment-Specific Link Quality Fluctuation in Low-Power Wireless Networks
por: Kidane, Zegeye Mekasha, et al.
Publicado: (2026)

5G Cellular -- An Energy Efficiency Perspective
por: Panchal, Deven
Publicado: (2024)

Lagrange Index based Scheduling for Minimizing Age of Updates from Heterogeneous Sources
por: Mukherjee, Aniket, et al.
Publicado: (2026)

Enhancements to P4TG: Histogram-Based RTT Monitoring in the Data Plane
por: Ihle, Fabian, et al.
Publicado: (2025)

CarbonCP: Carbon-Aware DNN Partitioning with Conformal Prediction for Sustainable Edge Intelligence
por: Ke, Hongyu, et al.
Publicado: (2024)

NR Cell Identity-based Handover Decision-making Algorithm for High-speed Scenario within Dual Connectivity
por: Zhu, Zhiyi, et al.
Publicado: (2025)

Impact of Packetization on Network Calculus Analysis
por: Jiang, Yming
Publicado: (2025)

An In-Depth Investigation of LEO Satellite Topology Design Parameters
por: Zhang, Wenyi, et al.
Publicado: (2024)

Through the Lens of Google CrUX: Dissecting Web Browsing Experience Across Devices and Countries
por: Sengupta, Jayasree, et al.
Publicado: (2023)

An event-driven link-level simulator for validation of AFDX and Ethernet avionics networks
por: Vera-Soto, Pablo, et al.
Publicado: (2023)

Network Calculus Characterization of Congestion Control for Time-Varying Traffic
por: Lehal, Harvinder, et al.
Publicado: (2024)

AraSync: Precision Time Synchronization in Rural Wireless Living Lab
por: Nadim, Md, et al.
Publicado: (2024)

Enhancements to P4TG: Protocols, Performance, and Automation
por: Ihle, Fabian, et al.
Publicado: (2025)

An Introductory Study on the Power Consumption Overhead of ERC-4337 Bundlers
por: Arusoaie, Andrei, et al.
Publicado: (2025)

Extending the Network Calculus Algorithmic Toolbox for Ultimately Pseudo-Periodic Functions: Pseudo-Inverse and Composition
por: Zippo, Raffaele, et al.
Publicado: (2022)

Performance Evaluation of LoRa for IoT Applications in Non-Terrestrial Networks via ns-3
por: Traspadini, Alessandro, et al.
Publicado: (2025)

Consistent Channel Hopping Algorithms for the Multichannel Rendezvous Problem with Heterogeneous Available Channel Sets
por: Liu, Yiwei, et al.
Publicado: (2025)

Network Anatomy and Real-Time Measurement of Nvidia GeForce NOW Cloud Gaming
por: Lyu, Minzhao, et al.
Publicado: (2024)

Metrics for Assessing Changes in Flow-based Networks
por: Rzepka, Michał, et al.
Publicado: (2025)

Performance Guarantees for Data Freshness in Resource-Constrained Adversarial IoT Systems
por: Dadlani, Aresh, et al.
Publicado: (2025)

On the Benefits of Traffic "Reprofiling'' -- The Single Hop Case
por: Song, Jiayi, et al.
Publicado: (2021)

Age of Information Analysis for Multi-Priority Queue and NOMA Enabled C-V2X in IoV
por: Zhang, Zheng, et al.
Publicado: (2024)

Evaluating Learning Congestion control Schemes for LEO Constellations
por: Mazilu, Mihai, et al.
Publicado: (2025)