A New Era in Human Factors Engineering: A Survey of the Applications and Prospects of Large Multimodal Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fan, Li, Ching-Hung, Lee, Su, Han, Shanshan, Feng, Zhuoxuan, Jiang, Zhu, Sun
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909208983633920
author Fan, Li
Ching-Hung, Lee
Su, Han
Shanshan, Feng
Zhuoxuan, Jiang
Zhu, Sun
author_facet Fan, Li
Ching-Hung, Lee
Su, Han
Shanshan, Feng
Zhuoxuan, Jiang
Zhu, Sun
contents In recent years, the potential applications of Large Multimodal Models (LMMs) in fields such as healthcare, social psychology, and industrial design have attracted wide research attention, providing new directions for human factors research. For instance, LMM-based smart systems have become novel research subjects of human factors studies, and LMM introduces new research paradigms and methodologies to this field. Therefore, this paper aims to explore the applications, challenges, and future prospects of LMM in the domain of human factors and ergonomics through an expert-LMM collaborated literature review. Specifically, a novel literature review method is proposed, and research studies of LMM-based accident analysis, human modelling and intervention design are introduced. Subsequently, the paper discusses future trends of the research paradigm and challenges of human factors and ergonomics studies in the era of LMMs. It is expected that this study can provide a valuable perspective and serve as a reference for integrating human factors with artificial intelligence.
format Preprint
id arxiv_https___arxiv_org_abs_2405_13426
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A New Era in Human Factors Engineering: A Survey of the Applications and Prospects of Large Multimodal Models
Fan, Li
Ching-Hung, Lee
Su, Han
Shanshan, Feng
Zhuoxuan, Jiang
Zhu, Sun
Human-Computer Interaction
Artificial Intelligence
In recent years, the potential applications of Large Multimodal Models (LMMs) in fields such as healthcare, social psychology, and industrial design have attracted wide research attention, providing new directions for human factors research. For instance, LMM-based smart systems have become novel research subjects of human factors studies, and LMM introduces new research paradigms and methodologies to this field. Therefore, this paper aims to explore the applications, challenges, and future prospects of LMM in the domain of human factors and ergonomics through an expert-LMM collaborated literature review. Specifically, a novel literature review method is proposed, and research studies of LMM-based accident analysis, human modelling and intervention design are introduced. Subsequently, the paper discusses future trends of the research paradigm and challenges of human factors and ergonomics studies in the era of LMMs. It is expected that this study can provide a valuable perspective and serve as a reference for integrating human factors with artificial intelligence.
title A New Era in Human Factors Engineering: A Survey of the Applications and Prospects of Large Multimodal Models
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2405.13426