Cover Image

Queueing-Aware Optimization of Reasoning Tokens for Accuracy-Latency Trade-offs in LLM Servers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ozbas, Emre, Bastopcu, Melih
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Information Theory Networking and Internet Architecture Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Balancing Information Accuracy and Response Timeliness in Networked LLMs
by: Turkmen, Yigit, et al.
Published: (2025)

How to Maximize Efficiency in Systems with Exhausted Workers
by: Sariisik, Elif Beray, et al.
Published: (2025)

Characterizing Information Accuracy in Timeliness-Based Gossip Networks
by: Tekez, Emirhan, et al.
Published: (2026)

Modeling Interfering Sources in Shared Queues for Timely Computations in Edge Computing Systems
by: Akar, Nail, et al.
Published: (2024)

Age of $k$-out-of-$n$ Systems on a Gossip Network
by: Bayram, Erkan, et al.
Published: (2024)

The Role of Gossiping for Information Dissemination over Networked Agents
by: Bastopcu, Melih, et al.
Published: (2022)

When Semantic Communication Meets Queueing: Cross-Layer Latency and Task Fidelity Optimization
by: Sagduyu, Yalin E., et al.
Published: (2026)

Timely Information for Strategic Persuasion
by: Gundogan, Ahmet Bugra, et al.
Published: (2025)

Latency Optimization for Wireless Federated Learning in Multihop Networks
by: Shaon, Shaba, et al.
Published: (2025)

Stability Analysis of Device-to-Device Relay-Assisted Cellular Networks
by: Deb, Soubhik, et al.
Published: (2018)

On Balancing Sparsity with Reliable Connectivity in Distributed Network Design with Random K-out Graphs
by: Sood, Mansi, et al.
Published: (2025)

Optimizing Profitability in Timely Gossip Networks
by: Kaswan, Priyanka, et al.
Published: (2024)

Optimal Pricing in Multi Server Systems
by: S, Ashok Krishnan K., et al.
Published: (2021)

Fully Decentralized Task Offloading in Multi-Access Edge Computing Systems
by: Aggarwal, Shubham, et al.
Published: (2024)

Reinforcement Learning with Non-Cumulative Objective
by: Cui, Wei, et al.
Published: (2023)

Optimal In-Network Distribution of Learning Functions for a Secure-by-Design Programmable Data Plane of Next-Generation Networks
by: Spina, Mattia Giovanni, et al.
Published: (2024)

Agentic DDQN-Based Scheduling for Licensed and Unlicensed Band Allocation in Sidelink Networks
by: Chou, Po-Heng, et al.
Published: (2025)

How to Make Money From Fresh Data: Subscription Strategies in Age-Based Systems
by: Kaswan, Priyanka, et al.
Published: (2024)

Optimal Radio Resource Management for ISAC Under Imperfect Information: A Resource Economy-Driven Perspective
by: Abanto-Leon, Luis F., et al.
Published: (2026)

Scheduling Policies in a Multi-Source Status Update System with Dedicated and Shared Servers
by: Liyanaarachchi, Sahan, et al.
Published: (2024)

Uplink resource allocation optimization for user-centric cell-free MIMO networks
by: Li, Zehua, et al.
Published: (2024)

Decentralized Uplink Adaptive Compression for Cell-Free MIMO with Limited Fronthaul
by: Li, Zehua, et al.
Published: (2025)

Optimizing the Trade-off Between Throughput and PAoI Outage Exponents
by: Yeh, Tai-Chun, et al.
Published: (2025)

AoI-Aware Resource Allocation with Deep Reinforcement Learning for HAPS-V2X Networks
by: Ince, Ahmet Melih, et al.
Published: (2025)

Position Aware 60 GHz mmWave Beamforming for V2V Communications Utilizing Deep Learning
by: Mollah, Muhammad Baqer, et al.
Published: (2024)

Black-Box Edge AI Model Selection with Conformal Latency and Accuracy Guarantees
by: Kalør, Anders E., et al.
Published: (2025)

Rack Position Optimization in Large-Scale Heterogeneous Data Centers
by: Chen, Chang-Lin, et al.
Published: (2025)

Minimizing Queue Length Regret for Arbitrarily Varying Channels
by: Krishnakumar, G, et al.
Published: (2025)

State-Aware Perturbation Optimization for Robust Deep Reinforcement Learning
by: Zhang, Zongyuan, et al.
Published: (2025)

Semantic-Aware Remote Estimation of Multiple Markov Sources Under Constraints
by: Luo, Jiping, et al.
Published: (2024)

Joint Energy and Latency Optimization in Federated Learning over Cell-Free Massive MIMO Networks
by: Mahmoudi, Afsaneh, et al.
Published: (2024)

Locational Pricing for Generative-AI Services via Token-Flow Market Clearing
by: Liu, Shaohui
Published: (2026)

Learning to Interfere in Non-Orthogonal Multiple-Access Joint Source-Channel Coding
by: Yilmaz, Selim F., et al.
Published: (2025)

Semantic Channel Equalization Strategies for Deep Joint Source-Channel Coding
by: Pannacci, Lorenzo, et al.
Published: (2025)

Channel-Adaptive Edge AI: Maximizing Inference Throughput by Adapting Computational Complexity to Channel States
by: Zhang, Jierui, et al.
Published: (2026)

AutoBS: Autonomous Base Station Deployment with Reinforcement Learning and Digital Network Twins
by: Lee, Ju-Hyung, et al.
Published: (2025)

Knowledge Distillation from Language-Oriented to Emergent Communication for Multi-Agent Remote Control
by: Kim, Yongjun, et al.
Published: (2024)

A Multi-Task Oriented Semantic Communication Framework for Autonomous Vehicles
by: Eldeeb, Eslam, et al.
Published: (2024)

CVaR-Based Variational Quantum Optimization for User Association in Handoff-Aware Vehicular Networks
by: Yan, Zijiang, et al.
Published: (2025)

Age of Job Completion Minimization with Stable Queues
by: Mitrolaris, Stavros, et al.
Published: (2025)