Image de couverture de livre

LiveVLM: Efficient Online Video Understanding via Streaming-Oriented KV Cache and Retrieval

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ning, Zhenyu, Liu, Guangda, Jin, Qihao, Li, Chengwei, Ding, Wenchao, Guo, Minyi, Zhao, Jieru
Format:	Preprint
Publié:	2025
Sujets:	Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

FreeKV: Boosting KV Cache Retrieval for Efficient LLM Inference
par: Liu, Guangda, et autres
Publié: (2025)

Inf-MLLM: Efficient Streaming Inference of Multimodal Large Language Models on a Single GPU
par: Ning, Zhenyu, et autres
Publié: (2024)

ClusterKV: Manipulating LLM KV Cache in Semantic Space for Recallable Compression
par: Liu, Guangda, et autres
Publié: (2024)

STREAMINGGS: Voxel-Based Streaming 3D Gaussian Splatting with Memory Optimization and Architectural Support
par: Zhang, Chenqi, et autres
Publié: (2025)

Decouple and Cache: KV Cache Construction for Streaming Video Understanding
par: Pang, Zhanzhong, et autres
Publié: (2026)

HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understanding
par: Zhang, Haowei, et autres
Publié: (2026)

StreamMem: Query-Agnostic KV Cache Memory for Streaming Video Understanding
par: Yang, Yanlai, et autres
Publié: (2025)

StreamKV: Streaming Video Question-Answering with Segment-based KV Cache Retrieval and Compression
par: Chen, Yilong, et autres
Publié: (2025)

Streaming Video Question-Answering with In-context Video KV-Cache Retrieval
par: Di, Shangzhe, et autres
Publié: (2025)

SparseTem: Boosting the Efficiency of CNN-Based Video Encoders by Exploiting Temporal Continuity
par: Wang, Kunyun, et autres
Publié: (2024)

LiveStar: Live Streaming Assistant for Real-World Online Video Understanding
par: Yang, Zhenyu, et autres
Publié: (2025)

V-Rex: Real-Time Streaming Video LLM Acceleration via Dynamic KV Cache Retrieval
par: Kim, Donghyuk, et autres
Publié: (2025)

Communication-Efficient Diffusion Denoising Parallelization via Reuse-then-Predict Mechanism
par: Wang, Kunyun, et autres
Publié: (2025)

InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding
par: Kim, Minsoo, et autres
Publié: (2025)

Venus: An Efficient Edge Memory-and-Retrieval System for VLM-based Online Video Understanding
par: Ye, Shengyuan, et autres
Publié: (2025)

Improving the Serving Performance of Multi-LoRA Large Language Models via Efficient LoRA and KV Cache Management
par: Zhang, Hang, et autres
Publié: (2025)

StreamGrid: Streaming Point Cloud Analytics via Compulsory Splitting and Deterministic Termination
par: Feng, Yu, et autres
Publié: (2025)

MuKV: Multi-Grained KV Cache Compression for Long Streaming Video Question-Answering
par: Xiao, Junbin, et autres
Publié: (2026)

Going Down Memory Lane: Scaling Tokens for Video Stream Understanding with Dynamic KV-Cache Memory
par: Agarwal, Vatsal, et autres
Publié: (2026)

Efficient Unified Caching for Accelerating Heterogeneous AI Workloads
par: Wang, Tianze, et autres
Publié: (2025)

Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Models
par: Ji, Yicheng, et autres
Publié: (2026)

LouisKV: Efficient KV Cache Retrieval for Long Input-Output Sequences
par: Wu, Wenbo, et autres
Publié: (2025)

Potamoi: Accelerating Neural Rendering via a Unified Streaming Architecture
par: Feng, Yu, et autres
Publié: (2024)

StreamingVLM: Real-Time Understanding for Infinite Video Streams
par: Xu, Ruyi, et autres
Publié: (2025)

Hierarchical Source-to-Post-Route QoR Prediction in High-Level Synthesis with GNNs
par: Gao, Mingzhe, et autres
Publié: (2024)

AutoVCoder: A Systematic Framework for Automated Verilog Code Generation using LLMs
par: Gao, Mingzhe, et autres
Publié: (2024)

An Optimizing Framework on MLIR for Efficient FPGA-based Accelerator Generation
par: Zhang, Weichuang, et autres
Publié: (2024)

ScoutAttention: Efficient KV Cache Offloading via Layer-Ahead CPU Pre-computation for LLM Inference
par: Zhang, Qiuyang, et autres
Publié: (2026)

RazorAttention: Efficient KV Cache Compression Through Retrieval Heads
par: Tang, Hanlin, et autres
Publié: (2024)

CacheFlow: Compressive Streaming Memory for Efficient Long-Form Video Understanding
par: Patel, Shrenik, et autres
Publié: (2025)

EchoKV: Efficient KV Cache Compression via Similarity-Based Reconstruction
par: Ji, Shiyu, et autres
Publié: (2026)

AhaKV: Adaptive Holistic Attention-Driven KV Cache Eviction for Efficient Inference of Large Language Models
par: Gu, Yifeng, et autres
Publié: (2025)

StreamForest: Efficient Online Video Understanding with Persistent Event Memory
par: Zeng, Xiangyu, et autres
Publié: (2025)

Efficient Remote KV Cache Reuse with GPU-native Video Codec
par: Mi, Liang, et autres
Publié: (2026)

Online Misinformation Detection in Live Streaming Videos
par: Cao, Rui
Publié: (2025)

CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving
par: Liu, Yuhan, et autres
Publié: (2023)

ProphetKV: User-Query-Driven Selective Recomputation for Efficient KV Cache Reuse in Retrieval-Augmented Generation
par: Wang, Shihao, et autres
Publié: (2026)

AccKV: Towards Efficient Audio-Video LLMs Inference via Adaptive-Focusing and Cross-Calibration KV Cache Optimization
par: Jiang, Zhonghua, et autres
Publié: (2025)

GUI-KV: Efficient GUI Agents via KV Cache with Spatio-Temporal Awareness
par: Huang, Kung-Hsiang, et autres
Publié: (2025)

SentenceKV: Efficient LLM Inference via Sentence-Level Semantic KV Caching
par: Zhu, Yuxuan, et autres
Publié: (2025)