Cover Image

Inf-MLLM: Efficient Streaming Inference of Multimodal Large Language Models on a Single GPU

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ning, Zhenyu, Zhao, Jieru, Jin, Qihao, Ding, Wenchao, Guo, Minyi
Format: Preprint
Published: 2024
Subjects:
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Distributed, Parallel, and Cluster Computing
Performance
Online Access:
Acceder al recurso
Tags: Add Tag
No Tags, Be the first to tag this record!
Be the first to leave a comment!
You must be logged in first

Similar Items