Imagen de Portada

Staircase Streaming for Low-Latency Multi-Agent Inference

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Junlin, Wang, Jue, Zhen, Xu, Athiwaratkun, Ben, Dhingra, Bhuwan, Zhang, Ce, Zou, James
Formato:	Preprint
Publicado:	2025
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Think Deep, Think Fast: Investigating Efficiency of Verifier-free Inference-time-scaling Methods
por: Wang, Junlin, et al.
Publicado: (2025)

How Much Backtracking is Enough? Exploring the Interplay of SFT and RL in Enhancing LLM Reasoning
por: Cai, Hongyi James, et al.
Publicado: (2025)

Mixture-of-Agents Enhances Large Language Model Capabilities
por: Wang, Junlin, et al.
Publicado: (2024)

Adversarial Math Word Problem Generation
por: Xie, Roy, et al.
Publicado: (2024)

Improving Model Alignment Through Collective Intelligence of Open-Source LLMS
por: Wang, Junlin, et al.
Publicado: (2025)

Scaling Instruction-Tuned LLMs to Million-Token Contexts via Hierarchical Synthetic Data Generation
por: He, Linda, et al.
Publicado: (2025)

GenEOL: Harnessing the Generative Power of LLMs for Training-Free Sentence Embeddings
por: Thirukovalluru, Raghuveer, et al.
Publicado: (2024)

Data Diversification Methods In Alignment Enhance Math Performance In LLMs
por: Dokmeci, Berkan, et al.
Publicado: (2025)

Coding Agents are Effective Long-Context Processors
por: Cao, Weili, et al.
Publicado: (2026)

Fuzzy Speculative Decoding for a Tunable Accuracy-Runtime Tradeoff
por: Holsman, Maximilian, et al.
Publicado: (2025)

Hierarchical Multi-Label Classification of Online Vaccine Concerns
por: Zhu, Chloe Qinyu, et al.
Publicado: (2024)

Real-time Factuality Assessment from Adversarial Feedback
por: Chen, Sanxing, et al.
Publicado: (2024)

Generalizability of Large Language Model-Based Agents: A Comprehensive Survey
por: Zhang, Minxing, et al.
Publicado: (2025)

When Does Divide and Conquer Work for Long Context LLM? A Noise Decomposition Framework
por: Xu, Zhen, et al.
Publicado: (2025)

To Trust or Not to Trust? Enhancing Large Language Models' Situated Faithfulness to External Contexts
por: Huang, Yukun, et al.
Publicado: (2024)

DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality
por: Huang, Yukun, et al.
Publicado: (2026)

Vision2Code: A Multi-Domain Benchmark for Evaluating Image-to-Code Generation
por: Periasami, Ajay Vikram, et al.
Publicado: (2026)

Squeeze Evolve: Unified Multi-Model Orchestration for Verifier-Free Evolution
por: Maheswaran, Monishwaran, et al.
Publicado: (2026)

Document-as-Image Representations Fall Short for Scientific Retrieval
por: Khalighinejad, Ghazal, et al.
Publicado: (2026)

Pushing the Limits of On-Device Streaming ASR: A Compact, High-Accuracy English Model for Low-Latency Inference
por: Banfic, Nenad, et al.
Publicado: (2026)

Cite Pretrain: Retrieval-Free Knowledge Attribution for Large Language Models
por: Huang, Yukun, et al.
Publicado: (2025)

When Greedy Wins: Emergent Exploitation Bias in Meta-Bandit LLM Training
por: Chen, Sanxing, et al.
Publicado: (2025)

Calibrating Long-form Generations from Large Language Models
por: Huang, Yukun, et al.
Publicado: (2024)

Dragonfly: Multi-Resolution Zoom-In Encoding Enhances Vision-Language Models
por: Thapa, Rahul, et al.
Publicado: (2024)

DIAGPaper: Diagnosing Valid and Specific Weaknesses in Scientific Papers via Multi-Agent Reasoning
por: Zou, Zhuoyang, et al.
Publicado: (2026)

Prompt Cache: Modular Attention Reuse for Low-Latency Inference
por: Gim, In, et al.
Publicado: (2023)

Automated Benchmark Auditing for AI Agents and Large Language Models
por: Wang, Junlin, et al.
Publicado: (2026)

Over-Searching in Search-Augmented Large Language Models
por: Xie, Roy, et al.
Publicado: (2026)

Towards Low-Latency Event Stream-based Visual Object Tracking: A Slow-Fast Approach
por: Wang, Shiao, et al.
Publicado: (2025)

Evolutionary Enhanced Multi-Agent Reinforcement Learning for Cooperative Air Combat
por: Li, Chengwei, et al.
Publicado: (2026)

Guided Streaming Stochastic Interpolant Policy
por: Jiang, Puming, et al.
Publicado: (2026)

Raccoon: Prompt Extraction Benchmark of LLM-Integrated Applications
por: Wang, Junlin, et al.
Publicado: (2024)

PPS-QMIX: Periodically Parameter Sharing for Accelerating Convergence of Multi-Agent Reinforcement Learning
por: Zhang, Ke, et al.
Publicado: (2024)

FlashSVD: Memory-Efficient Inference with Streaming for Low-Rank Models
por: Shao, Zishan, et al.
Publicado: (2025)

Frequency-Adaptive Low-Latency Object Detection Using Events and Frames
por: Zhang, Haitian, et al.
Publicado: (2024)

Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time
por: Zhang, Zhenyu, et al.
Publicado: (2025)

Training-Free Activation Sparsity in Large Language Models
por: Liu, James, et al.
Publicado: (2024)

StreamServe: Adaptive Speculative Flows for Low-Latency Disaggregated LLM Serving
por: Kumar, Satyam, et al.
Publicado: (2026)

Large Language Model Partitioning for Low-Latency Inference at the Edge
por: Kafetzis, Dimitrios, et al.
Publicado: (2025)

TClone: Low-Latency Forking of Live GUI Environments for Computer-Use Agents
por: Huang, Yutong, et al.
Publicado: (2026)