Cover Image

Beyond the Buzz: A Pragmatic Take on Inference Disaggregation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mitra, Tiyasa, Borkar, Ritika, Bhatia, Nidhi, Matas, Ramon, Raj, Shivam, Mudigere, Dheevatsa, Zhao, Ritchie, Golub, Maximilian, Dutta, Arpan, Madduri, Sailaja, Jani, Dharmesh, Pharris, Brian, Rouhani, Bita Darvish
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Helix Parallelism: Rethinking Sharding Strategies for Interactive Multi-Million-Token LLM Decoding
by: Bhatia, Nidhi, et al.
Published: (2025)

LatentMoE: Toward Optimal Accuracy per FLOP and Parameter in Mixture of Experts
by: Elango, Venmugil, et al.
Published: (2026)

SPEED-Bench: A Unified and Diverse Benchmark for Speculative Decoding
by: Abramovich, Talor, et al.
Published: (2026)

Key, Value, Compress: A Systematic Exploration of KV Cache Compression Techniques
by: Javidnia, Neusha, et al.
Published: (2025)

Efficient MoE Serving in the Memory-Bound Regime: Balance Activated Experts, Not Tokens
by: Yu, Yanpeng, et al.
Published: (2025)

Buzz Buzz: Haptic Cuing of Road Conditions in Autonomous Cars for Drivers Engaged in Secondary Tasks
by: Pandey, Shivam
Published: (2026)

Nonuniform-Tensor-Parallelism: Mitigating GPU failure impact for Scaled-up LLM Training
by: Arfeen, Daiyaan, et al.
Published: (2025)

Disaggregated Multi-Tower: Topology-aware Modeling Technique for Efficient Large-Scale Recommendation
by: Luo, Liang, et al.
Published: (2024)

Accelerating RL Post-Training Rollouts via System-Integrated Speculative Decoding
by: Iso, Hayate, et al.
Published: (2026)

ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration
by: Ai, Mengting, et al.
Published: (2025)

An Asymptotic CVaR Measure of Risk for Markov Chains
by: Patel, Shivam, et al.
Published: (2024)

Guess-Verify-Refine: Data-Aware Top-K for Sparse-Attention Decoding on Blackwell via Temporal Correlation
by: Cheng, Long, et al.
Published: (2026)

A Parameterized Decision Tree Classifier to Identify Customers' Online Purchase Intention: An Indian Case
by: Sheel Nidhi Tripathi, et al.
Published: (2025)

Emission Distribution for the quantas of Maxwell-Chern-Simon Gauge Field coupled to External Current
by: Kar, Tiyasa
Published: (2021)

ABCB1 Polymorphism in HIV‐Infected Individuals Taking Antiretroviral Drugs
by: HariOm Singh, et al.
Published: (2025)

Glasgow's Buzzing pollinator survey results
by: Bairner, Suzanne Z
Published: (2016)

Analyzing Uniform WKB for Deformed QM Or How Not to Quantize the SW Curve
by: Jain, Dharmesh
Published: (2026)

Women in fisheries case studies: India
by: Shah, Dharmesh
Published: (2010)

Lebenswissenschaften: Longevity ‐ ein neues Buzz‐Word
by: Gunter Festel
Published: (2024)

Multitask Online Learning: Listen to the Neighborhood Buzz
by: Achddou, Juliette, et al.
Published: (2023)

BEA Discoveries 2010: BEA beyond the Buzz
by: Fox, Bette-Lee, et al.
Published: (2010)

Noteworthiness of Sustainable Education in Higher Education: A Qualitative Study
by: Khyati Manchanda, et al.
Published: (2025)

An Investigation into Emotional Intelligence, Foreign Language Anxiety and Empathy through a Cognitive-Affective Course in an EFL Context
by: Ali Rouhani
Published: (2008)

Relativistic Fluid Dynamics in Curved Spacetime: a Novel Effective Hamiltonian Approach
by: Mitra, Arpan Krishna, et al.
Published: (2025)

Drivers and Challenges in Achieving Corporate Carbon Neutrality—Qualitative Investigation of Carbon Capture, Utilization, and Storage Technologies
by: Meena Bhatia, et al.
Published: (2024)

Thermodynamic Characteristics of a Fermi Gas with an Invariant Energy Scale and its Astrophysical Implications
by: Kar, Tiyasa, et al.
Published: (2026)

Stochastic Approximation with Two Time Scales: The General Case
by: Borkar, Vivek S
Published: (2024)

Forecasting the Buzz: Enriching Hashtag Popularity Prediction with LLM Reasoning
by: Xu, Yifei, et al.
Published: (2025)

International. Kabila sends a message to the world: "Buzz off"
Published: (1997)

Beyond the Buzz: Strategic Paths for Enabling Useful NISQ Applications
by: Hegde, Pratibha Raghupati, et al.
Published: (2024)

Non-Commutative fluid: an alternative source of cosmic acceleration
by: Das, Raj Kumar, et al.
Published: (2025)

Quantitative (Chlorophyll-a) and qualitative (species composition) seasonal fluctuations of phytoplankton in Lavan coastal waters (North of the Persian Gulf)
by: Rouhani Ghadikolaei, K.
Published: (2001)

Spinning Black Hole in a Fluid
by: Dalui, Surojit, et al.
Published: (2024)

Learning the optimal state-feedback via supervised imitation learning
by: Tailor, Dharmesh, et al.
Published: (2019)

Challenges and Opportunities to Enable Large-Scale Computing via Heterogeneous Chiplets
by: Yang, Zhuoping, et al.
Published: (2023)

Eigenvalues in microeconomics
by: Golub, Benjamin
Published: (2025)

Incapacity
by: Golub, Spencer
Published: (2018)

Grief, Meaning, and Narratives
by: Camil Golub
Published: (2025)

‘Never a Colony’?: Rethinking the Colonisation of Enga Province, Papua New Guinea
by: Alex Golub
Published: (2024)

Del neo-wilsonianismo al militarismo: los patrones movedizos de la política norteamericana
by: Philip S. Golub
Published: (2003)