A Survey of Resource-efficient LLM and Multimodal Foundation Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Mengwei, Yin, Wangsong, Cai, Dongqi, Yi, Rongjie, Xu, Daliang, Wang, Qipeng, Wu, Bingyang, Zhao, Yihao, Yang, Chen, Wang, Shihe, Zhang, Qiyang, Lu, Zhenyan, Zhang, Li, Wang, Shangguang, Li, Yuanchun, Liu, Yunxin, Jin, Xin, Liu, Xuanzhe
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910615442817024
author Xu, Mengwei
Yin, Wangsong
Cai, Dongqi
Yi, Rongjie
Xu, Daliang
Wang, Qipeng
Wu, Bingyang
Zhao, Yihao
Yang, Chen
Wang, Shihe
Zhang, Qiyang
Lu, Zhenyan
Zhang, Li
Wang, Shangguang
Li, Yuanchun
Liu, Yunxin
Jin, Xin
Liu, Xuanzhe
author_facet Xu, Mengwei
Yin, Wangsong
Cai, Dongqi
Yi, Rongjie
Xu, Daliang
Wang, Qipeng
Wu, Bingyang
Zhao, Yihao
Yang, Chen
Wang, Shihe
Zhang, Qiyang
Lu, Zhenyan
Zhang, Li
Wang, Shangguang
Li, Yuanchun
Liu, Yunxin
Jin, Xin
Liu, Xuanzhe
contents Large foundation models, including large language models (LLMs), vision transformers (ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine learning lifecycle, from training to deployment. However, the substantial advancements in versatility and performance these models offer come at a significant cost in terms of hardware resources. To support the growth of these large models in a scalable and environmentally sustainable way, there has been a considerable focus on developing resource-efficient strategies. This survey delves into the critical importance of such research, examining both algorithmic and systemic aspects. It offers a comprehensive analysis and valuable insights gleaned from existing literature, encompassing a broad array of topics from cutting-edge model architectures and training/serving algorithms to practical system designs and implementations. The goal of this survey is to provide an overarching understanding of how current approaches are tackling the resource challenges posed by large foundation models and to potentially inspire future breakthroughs in this field.
format Preprint
id arxiv_https___arxiv_org_abs_2401_08092
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Survey of Resource-efficient LLM and Multimodal Foundation Models
Xu, Mengwei
Yin, Wangsong
Cai, Dongqi
Yi, Rongjie
Xu, Daliang
Wang, Qipeng
Wu, Bingyang
Zhao, Yihao
Yang, Chen
Wang, Shihe
Zhang, Qiyang
Lu, Zhenyan
Zhang, Li
Wang, Shangguang
Li, Yuanchun
Liu, Yunxin
Jin, Xin
Liu, Xuanzhe
Machine Learning
Artificial Intelligence
Distributed, Parallel, and Cluster Computing
Large foundation models, including large language models (LLMs), vision transformers (ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine learning lifecycle, from training to deployment. However, the substantial advancements in versatility and performance these models offer come at a significant cost in terms of hardware resources. To support the growth of these large models in a scalable and environmentally sustainable way, there has been a considerable focus on developing resource-efficient strategies. This survey delves into the critical importance of such research, examining both algorithmic and systemic aspects. It offers a comprehensive analysis and valuable insights gleaned from existing literature, encompassing a broad array of topics from cutting-edge model architectures and training/serving algorithms to practical system designs and implementations. The goal of this survey is to provide an overarching understanding of how current approaches are tackling the resource challenges posed by large foundation models and to potentially inspire future breakthroughs in this field.
title A Survey of Resource-efficient LLM and Multimodal Foundation Models
topic Machine Learning
Artificial Intelligence
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2401.08092