Inf-MLLM: Efficient Streaming Inference of Multimodal Large Language Models on a Single GPU

Documenti analoghi

• HybridGen: Efficient LLM Generative Inference via CPU-GPU Hybrid Computing
  di: Lin, Mao, et al.
  Pubblicazione: (2026)
• HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices
  di: Zhao, Xuanlei, et al.
  Pubblicazione: (2024)
• Efficient allocation of image recognition and LLM tasks on multi-GPU system
  di: Lawenda, Marcin, et al.
  Pubblicazione: (2025)
• Efficient GPU-Centered Singular Value Decomposition Using the Divide-and-Conquer Method
  di: Liu, Shifang, et al.
  Pubblicazione: (2025)
• CUTHERMO: Understanding GPU Memory Inefficiencies with Heat Map Profiling
  di: Zhao, Yanbo, et al.
  Pubblicazione: (2025)