Guardado en:
| Autores principales: | Rathi, Saksham, Preeti, Vutukuru, Mythili |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2605.06046 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Reliability Estimation of News Media Sources: Birds of a Feather Flock Together
por: Burdisso, Sergio, et al.
Publicado: (2024)
por: Burdisso, Sergio, et al.
Publicado: (2024)
BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching
por: Zheng, Zhen, et al.
Publicado: (2024)
por: Zheng, Zhen, et al.
Publicado: (2024)
Hydragen: High-Throughput LLM Inference with Shared Prefixes
por: Juravsky, Jordan, et al.
Publicado: (2024)
por: Juravsky, Jordan, et al.
Publicado: (2024)
Full-Graph vs. Mini-Batch Training: Comprehensive Analysis from a Batch Size and Fan-Out Size Perspective
por: Liu, Mengfan, et al.
Publicado: (2026)
por: Liu, Mengfan, et al.
Publicado: (2026)
Researchers of a Feather Flock Together: Endogamy Recruitment Tracks for Industrial Researchers
por: Céline Antonin, et al.
Publicado: (2025)
por: Céline Antonin, et al.
Publicado: (2025)
RW-TTT: Batched Serving for Request-Owned Test-Time Training State
por: Yang, Jian, et al.
Publicado: (2026)
por: Yang, Jian, et al.
Publicado: (2026)
SCORPIO: Serving the Right Requests at the Right Time for Heterogeneous SLOs in LLM Inference
por: Tang, Yinghao, et al.
Publicado: (2025)
por: Tang, Yinghao, et al.
Publicado: (2025)
AdaBatchGrad: Combining Adaptive Batch Size and Adaptive Step Size
por: Ostroukhov, Petr, et al.
Publicado: (2024)
por: Ostroukhov, Petr, et al.
Publicado: (2024)
Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving
por: Gao, Shihong, et al.
Publicado: (2025)
por: Gao, Shihong, et al.
Publicado: (2025)
Partially Observable Gaussian Process Network and Doubly Stochastic Variational Inference
por: Kiroriwal, Saksham, et al.
Publicado: (2025)
por: Kiroriwal, Saksham, et al.
Publicado: (2025)
Birds of a Feather Flock Together: Background-Invariant Representations via Linear Structure in VLMs
por: Zaazou, Youssef, et al.
Publicado: (2026)
por: Zaazou, Youssef, et al.
Publicado: (2026)
PrefixWall: Mitigating Prefix Caching Side Channels in Shared LLM Systems
por: Pennas, Panagiotis Georgios, et al.
Publicado: (2026)
por: Pennas, Panagiotis Georgios, et al.
Publicado: (2026)
No Request Left Behind: Tackling Heterogeneity in Long-Context LLM Inference with Medha
por: Agrawal, Amey, et al.
Publicado: (2024)
por: Agrawal, Amey, et al.
Publicado: (2024)
Semi-Clairvoyant Scheduling of Speculative Decoding Requests to Minimize LLM Inference Latency
por: Li, Ruixiao, et al.
Publicado: (2025)
por: Li, Ruixiao, et al.
Publicado: (2025)
MarginGate: Sparse Margin-Triggered Verification for Batch-Invariant LLM Inference
por: Chu, Kexin, et al.
Publicado: (2026)
por: Chu, Kexin, et al.
Publicado: (2026)
MemoryGraft: Persistent Compromise of LLM Agents via Poisoned Experience Retrieval
por: Srivastava, Saksham Sahai, et al.
Publicado: (2025)
por: Srivastava, Saksham Sahai, et al.
Publicado: (2025)
Sparse Prefix Caching for Hybrid and Recurrent LLM Serving
por: Shirokikh, Mikhail, et al.
Publicado: (2026)
por: Shirokikh, Mikhail, et al.
Publicado: (2026)
Inference for Batched Adaptive Experiments
por: Kemper, Jan, et al.
Publicado: (2025)
por: Kemper, Jan, et al.
Publicado: (2025)
Feather: An Elegant Solution to Effective DNN Sparsification
por: Georgoulakis, Athanasios Glentis, et al.
Publicado: (2023)
por: Georgoulakis, Athanasios Glentis, et al.
Publicado: (2023)
Convergence Bound and Critical Batch Size of Muon Optimizer
por: Sato, Naoki, et al.
Publicado: (2025)
por: Sato, Naoki, et al.
Publicado: (2025)
Polar Sparsity: High Throughput Batched LLM Inferencing with Scalable Contextual Sparsity
por: Shrestha, Susav, et al.
Publicado: (2025)
por: Shrestha, Susav, et al.
Publicado: (2025)
Critical Batch Size Revisited: A Simple Empirical Approach to Large-Batch Language Model Training
por: Merrill, William, et al.
Publicado: (2025)
por: Merrill, William, et al.
Publicado: (2025)
Birds of a Different Feather Flock Together: Exploring Opportunities and Challenges in Animal-Human-Machine Teaming
por: Cohen, Myke C., et al.
Publicado: (2025)
por: Cohen, Myke C., et al.
Publicado: (2025)
Multi-Bin Batching for Increasing LLM Inference Throughput
por: Guldogan, Ozgur, et al.
Publicado: (2024)
por: Guldogan, Ozgur, et al.
Publicado: (2024)
Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling
por: Li, Shuaipeng, et al.
Publicado: (2024)
por: Li, Shuaipeng, et al.
Publicado: (2024)
Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training
por: Bergsma, Shane, et al.
Publicado: (2025)
por: Bergsma, Shane, et al.
Publicado: (2025)
AntBatchInfer: Elastic Batch Inference in the Kubernetes Cluster
por: Li, Siyuan, et al.
Publicado: (2024)
por: Li, Siyuan, et al.
Publicado: (2024)
AdvPrefix: An Objective for Nuanced LLM Jailbreaks
por: Zhu, Sicheng, et al.
Publicado: (2024)
por: Zhu, Sicheng, et al.
Publicado: (2024)
On the Role of Batch Size in Stochastic Conditional Gradient Methods
por: Islamov, Rustem, et al.
Publicado: (2026)
por: Islamov, Rustem, et al.
Publicado: (2026)
PackInfer: Compute- and I/O-Efficient Attention for Batched LLM Inference
por: Ning, Rui, et al.
Publicado: (2026)
por: Ning, Rui, et al.
Publicado: (2026)
Smaller Batches, Bigger Gains? Investigating the Impact of Batch Sizes on Reinforcement Learning Based Real-World Production Scheduling
por: Müller, Arthur, et al.
Publicado: (2024)
por: Müller, Arthur, et al.
Publicado: (2024)
Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
por: Recasens, Pol G., et al.
Publicado: (2025)
por: Recasens, Pol G., et al.
Publicado: (2025)
Prefix Grouper: Efficient GRPO Training through Shared-Prefix Forward
por: Liu, Zikang, et al.
Publicado: (2025)
por: Liu, Zikang, et al.
Publicado: (2025)
Collaborative Batch Size Optimization for Federated Learning
por: Geimer, Arno, et al.
Publicado: (2025)
por: Geimer, Arno, et al.
Publicado: (2025)
Hooves and Feathers Together
por: Breitigan, Roxanna
Publicado: (2013)
por: Breitigan, Roxanna
Publicado: (2013)
Increasing Batch Size Improves Convergence of Stochastic Gradient Descent with Momentum
por: Kamo, Keisuke, et al.
Publicado: (2025)
por: Kamo, Keisuke, et al.
Publicado: (2025)
Birds of a Feather Flock Together: The Impact of Top Management Team Faultlines on Environmental, Social, and Governance Performance
por: Hai Huang, et al.
Publicado: (2024)
por: Hai Huang, et al.
Publicado: (2024)
PrefixGPT: Prefix Adder Optimization by a Generative Pre-trained Transformer
por: Ding, Ruogu, et al.
Publicado: (2025)
por: Ding, Ruogu, et al.
Publicado: (2025)
PrefixQuant: Eliminating Outliers by Prefixed Tokens for Large Language Models Quantization
por: Chen, Mengzhao, et al.
Publicado: (2024)
por: Chen, Mengzhao, et al.
Publicado: (2024)
Beware of the Batch Size: Hyperparameter Bias in Evaluating LoRA
por: Lee, Sangyoon, et al.
Publicado: (2026)
por: Lee, Sangyoon, et al.
Publicado: (2026)
Ejemplares similares
-
Reliability Estimation of News Media Sources: Birds of a Feather Flock Together
por: Burdisso, Sergio, et al.
Publicado: (2024) -
BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching
por: Zheng, Zhen, et al.
Publicado: (2024) -
Hydragen: High-Throughput LLM Inference with Shared Prefixes
por: Juravsky, Jordan, et al.
Publicado: (2024) -
Full-Graph vs. Mini-Batch Training: Comprehensive Analysis from a Batch Size and Fan-Out Size Perspective
por: Liu, Mengfan, et al.
Publicado: (2026) -
Researchers of a Feather Flock Together: Endogamy Recruitment Tracks for Industrial Researchers
por: Céline Antonin, et al.
Publicado: (2025)