Saved in:
| Main Authors: | Chen, Yaoqi, Zhang, Jinkai, Lu, Baotong, Zhang, Qianxi, Zhang, Chengruidong, Liu, Jing, Luo, Jingjia, Liu, Di, Jiang, Huiqiang, Chen, Qi, Ding, Bailu, Yan, Xiao, Jiang, Jiawei, Chen, Chen, Zhang, Mingxing, Li, Cheng, Yang, Yuqing, Yang, Fan, Yang, Mao |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2505.02922 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
by: Liu, Di, et al.
Published: (2024)
by: Liu, Di, et al.
Published: (2024)
MTraining: Distributed Dynamic Sparse Attention for Efficient Ultra-Long Context Training
by: Li, Wenxuan, et al.
Published: (2025)
by: Li, Wenxuan, et al.
Published: (2025)
Accelerating Prefilling via Decoding-time Contribution Sparsity
by: He, Zhiyuan, et al.
Published: (2025)
by: He, Zhiyuan, et al.
Published: (2025)
Towards Efficient and Scalable Distributed Vector Search with RDMA
by: Zhi, Xiangyu, et al.
Published: (2025)
by: Zhi, Xiangyu, et al.
Published: (2025)
LeanK: Learnable K Cache Channel Pruning for Efficient Decoding
by: Zhang, Yike, et al.
Published: (2025)
by: Zhang, Yike, et al.
Published: (2025)
VecAttention: Vector-wise Sparse Attention for Accelerating Long Context Inference
by: Liu, Anmin, et al.
Published: (2026)
by: Liu, Anmin, et al.
Published: (2026)
Towards Robustness: A Critique of Current Vector Database Assessments
by: Wang, Zikai, et al.
Published: (2025)
by: Wang, Zikai, et al.
Published: (2025)
Scalable Distributed Vector Search via Accuracy Preserving Index Construction
by: Xu, Yuming, et al.
Published: (2025)
by: Xu, Yuming, et al.
Published: (2025)
SortedRL: Accelerating RL Training for LLMs through Online Length-Aware Scheduling
by: Zhang, Yiqi, et al.
Published: (2026)
by: Zhang, Yiqi, et al.
Published: (2026)
Scaling Up On-Device LLMs via Active-Weight Swapping Between DRAM and Flash
by: Jia, Fucheng, et al.
Published: (2025)
by: Jia, Fucheng, et al.
Published: (2025)
Parrot: Efficient Serving of LLM-based Applications with Semantic Variable
by: Lin, Chaofan, et al.
Published: (2024)
by: Lin, Chaofan, et al.
Published: (2024)
SCBench: A KV Cache-Centric Analysis of Long-Context Methods
by: Li, Yucheng, et al.
Published: (2024)
by: Li, Yucheng, et al.
Published: (2024)
MMInference: Accelerating Pre-filling for Long-Context VLMs via Modality-Aware Permutation Sparse Attention
by: Li, Yucheng, et al.
Published: (2025)
by: Li, Yucheng, et al.
Published: (2025)
Region-Adaptive Sampling for Diffusion Transformers
by: Liu, Ziming, et al.
Published: (2025)
by: Liu, Ziming, et al.
Published: (2025)
Unifying Sparse Attention with Hierarchical Memory for Scalable Long-Context LLM Serving
by: Zhao, Zihan, et al.
Published: (2026)
by: Zhao, Zihan, et al.
Published: (2026)
MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention
by: Jiang, Huiqiang, et al.
Published: (2024)
by: Jiang, Huiqiang, et al.
Published: (2024)
Efficient Graph-Based Approximate Nearest Neighbor Search Achieving: Low Latency Without Throughput Loss
by: Luo, Jingjia, et al.
Published: (2025)
by: Luo, Jingjia, et al.
Published: (2025)
Effects of soil spatial variability on the behaviour of the embankment supported with a combined retaining structure
by: Xiaoya Bian, et al.
Published: (2024)
by: Xiaoya Bian, et al.
Published: (2024)
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
by: Xu, Yuming, et al.
Published: (2024)
by: Xu, Yuming, et al.
Published: (2024)
FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
by: Ye, Zihao, et al.
Published: (2025)
by: Ye, Zihao, et al.
Published: (2025)
Personality-Guided Code Generation Using Large Language Models
by: Guo, Yaoqi, et al.
Published: (2024)
by: Guo, Yaoqi, et al.
Published: (2024)
Inferring Network Structure with Unobservable Nodes from Time Series Data
by: Chen, Mengyuan, et al.
Published: (2022)
by: Chen, Mengyuan, et al.
Published: (2022)
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
by: Ding, Yiran, et al.
Published: (2024)
by: Ding, Yiran, et al.
Published: (2024)
A First Look at Bugs in LLM Inference Engines
by: Liu, Mugeng, et al.
Published: (2025)
by: Liu, Mugeng, et al.
Published: (2025)
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
by: Jiang, Huiqiang, et al.
Published: (2023)
by: Jiang, Huiqiang, et al.
Published: (2023)
ConInfer: Context-Aware Inference for Training-Free Open-Vocabulary Remote Sensing Segmentation
by: Chen, Wenyang, et al.
Published: (2026)
by: Chen, Wenyang, et al.
Published: (2026)
DualPath: Breaking the Storage Bandwidth Bottleneck in Agentic LLM Inference
by: Wu, Yongtong, et al.
Published: (2026)
by: Wu, Yongtong, et al.
Published: (2026)
AnTKV: Anchor Token-Aware Sub-Bit Vector Quantization for KV Cache in Large Language Models
by: Li, Zeyu, et al.
Published: (2025)
by: Li, Zeyu, et al.
Published: (2025)
Tailored Local Electronic Environment of Co‐N4 Sites in Cobalt Phthalocyanines for Enhanced CO2 Reduction Reaction
by: Mengying Huang, et al.
Published: (2024)
by: Mengying Huang, et al.
Published: (2024)
MACRO: Advancing Multi-Reference Image Generation with Structured Long-Context Data
by: Chen, Zhekai, et al.
Published: (2026)
by: Chen, Zhekai, et al.
Published: (2026)
InstInfer: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference
by: Pan, Xiurui, et al.
Published: (2024)
by: Pan, Xiurui, et al.
Published: (2024)
Large Vision-Language Models as Emotion Recognizers in Context Awareness
by: Lei, Yuxuan, et al.
Published: (2024)
by: Lei, Yuxuan, et al.
Published: (2024)
Inference of Maximum Parsimony Phylogenetic Trees with Model‐Based Classical and Quantum Methods
by: Jiawei Zhang, et al.
Published: (2026)
by: Jiawei Zhang, et al.
Published: (2026)
Inference of maximum parsimony phylogenetic trees with model-based classical and quantum methods
by: Zhang, Jiawei, et al.
Published: (2025)
by: Zhang, Jiawei, et al.
Published: (2025)
Membership Inference Attack against Long-Context Large Language Models
by: Wang, Zixiong, et al.
Published: (2024)
by: Wang, Zixiong, et al.
Published: (2024)
Evolution of flat bands in MoSe$_2$/WSe$_2$ moiré lattices: A study combining machine learning and band unfolding methods
by: Yang, Shengguo, et al.
Published: (2024)
by: Yang, Shengguo, et al.
Published: (2024)
Chitosan‐Ag NPs Composite Smart Packaging Material with High Antibacterial Activity
by: Zhaoge Zhang, et al.
Published: (2025)
by: Zhaoge Zhang, et al.
Published: (2025)
Making Every Frame Matter: Continuous Activity Recognition in Streaming Video via Adaptive Video Context Modeling
by: Wu, Hao, et al.
Published: (2024)
by: Wu, Hao, et al.
Published: (2024)
Position Engineering: Boosting Large Language Models through Positional Information Manipulation
by: He, Zhiyuan, et al.
Published: (2024)
by: He, Zhiyuan, et al.
Published: (2024)
MISS: A Generative Pretraining and Finetuning Approach for Med-VQA
by: Chen, Jiawei, et al.
Published: (2024)
by: Chen, Jiawei, et al.
Published: (2024)
Similar Items
-
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
by: Liu, Di, et al.
Published: (2024) -
MTraining: Distributed Dynamic Sparse Attention for Efficient Ultra-Long Context Training
by: Li, Wenxuan, et al.
Published: (2025) -
Accelerating Prefilling via Decoding-time Contribution Sparsity
by: He, Zhiyuan, et al.
Published: (2025) -
Towards Efficient and Scalable Distributed Vector Search with RDMA
by: Zhi, Xiangyu, et al.
Published: (2025) -
LeanK: Learnable K Cache Channel Pruning for Efficient Decoding
by: Zhang, Yike, et al.
Published: (2025)