A Survey on Facial Expression Recognition of Static and Dynamic Emotions

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Yan, Yan, Shaoqi, Liu, Yang, Song, Wei, Liu, Jing, Chang, Yang, Mai, Xinji, Hu, Xiping, Zhang, Wenqiang, Gan, Zhongxue
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910580916355072
author Wang, Yan
Yan, Shaoqi
Liu, Yang
Song, Wei
Liu, Jing
Chang, Yang
Mai, Xinji
Hu, Xiping
Zhang, Wenqiang
Gan, Zhongxue
author_facet Wang, Yan
Yan, Shaoqi
Liu, Yang
Song, Wei
Liu, Jing
Chang, Yang
Mai, Xinji
Hu, Xiping
Zhang, Wenqiang
Gan, Zhongxue
contents Facial expression recognition (FER) aims to analyze emotional states from static images and dynamic sequences, which is pivotal in enhancing anthropomorphic communication among humans, robots, and digital avatars by leveraging AI technologies. As the FER field evolves from controlled laboratory environments to more complex in-the-wild scenarios, advanced methods have been rapidly developed and new challenges and apporaches are encounted, which are not well addressed in existing reviews of FER. This paper offers a comprehensive survey of both image-based static FER (SFER) and video-based dynamic FER (DFER) methods, analyzing from model-oriented development to challenge-focused categorization. We begin with a critical comparison of recent reviews, an introduction to common datasets and evaluation criteria, and an in-depth workflow on FER to establish a robust research foundation. We then systematically review representative approaches addressing eight main challenges in SFER (such as expression disturbance, uncertainties, compound emotions, and cross-domain inconsistency) as well as seven main challenges in DFER (such as key frame sampling, expression intensity variations, and cross-modal alignment). Additionally, we analyze recent advancements, benchmark performances, major applications, and ethical considerations. Finally, we propose five promising future directions and development trends to guide ongoing research. The project page for this paper can be found at https://github.com/wangyanckxx/SurveyFER.
format Preprint
id arxiv_https___arxiv_org_abs_2408_15777
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Survey on Facial Expression Recognition of Static and Dynamic Emotions
Wang, Yan
Yan, Shaoqi
Liu, Yang
Song, Wei
Liu, Jing
Chang, Yang
Mai, Xinji
Hu, Xiping
Zhang, Wenqiang
Gan, Zhongxue
Computer Vision and Pattern Recognition
Facial expression recognition (FER) aims to analyze emotional states from static images and dynamic sequences, which is pivotal in enhancing anthropomorphic communication among humans, robots, and digital avatars by leveraging AI technologies. As the FER field evolves from controlled laboratory environments to more complex in-the-wild scenarios, advanced methods have been rapidly developed and new challenges and apporaches are encounted, which are not well addressed in existing reviews of FER. This paper offers a comprehensive survey of both image-based static FER (SFER) and video-based dynamic FER (DFER) methods, analyzing from model-oriented development to challenge-focused categorization. We begin with a critical comparison of recent reviews, an introduction to common datasets and evaluation criteria, and an in-depth workflow on FER to establish a robust research foundation. We then systematically review representative approaches addressing eight main challenges in SFER (such as expression disturbance, uncertainties, compound emotions, and cross-domain inconsistency) as well as seven main challenges in DFER (such as key frame sampling, expression intensity variations, and cross-modal alignment). Additionally, we analyze recent advancements, benchmark performances, major applications, and ethical considerations. Finally, we propose five promising future directions and development trends to guide ongoing research. The project page for this paper can be found at https://github.com/wangyanckxx/SurveyFER.
title A Survey on Facial Expression Recognition of Static and Dynamic Emotions
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.15777