Affective Video Content Analysis: Decade Review and New Perspectives

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Xue, Junxiao, Wang, Jie, Wu, Xuecheng, Zhang, Qian
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929213900062720
author Xue, Junxiao
Wang, Jie
Wu, Xuecheng
Zhang, Qian
author_facet Xue, Junxiao
Wang, Jie
Wu, Xuecheng
Zhang, Qian
contents Video content is rich in semantics and has the ability to evoke various emotions in viewers. In recent years, with the rapid development of affective computing and the explosive growth of visual data, affective video content analysis (AVCA) as an essential branch of affective computing has become a widely researched topic. In this study, we comprehensively review the development of AVCA over the past decade, particularly focusing on the most advanced methods adopted to address the three major challenges of video feature extraction, expression subjectivity, and multimodal feature fusion. We first introduce the widely used emotion representation models in AVCA and describe commonly used datasets. We summarize and compare representative methods in the following aspects: (1) unimodal AVCA models, including facial expression recognition and posture emotion recognition; (2) multimodal AVCA models, including feature fusion, decision fusion, and attention-based multimodal models; (3) model performance evaluation standards. Finally, we discuss future challenges and promising research directions, such as emotion recognition and public opinion analysis, human-computer interaction, and emotional intelligence.
format Preprint
id arxiv_https___arxiv_org_abs_2310_17212
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Affective Video Content Analysis: Decade Review and New Perspectives
Xue, Junxiao
Wang, Jie
Wu, Xuecheng
Zhang, Qian
Computer Vision and Pattern Recognition
Artificial Intelligence
Video content is rich in semantics and has the ability to evoke various emotions in viewers. In recent years, with the rapid development of affective computing and the explosive growth of visual data, affective video content analysis (AVCA) as an essential branch of affective computing has become a widely researched topic. In this study, we comprehensively review the development of AVCA over the past decade, particularly focusing on the most advanced methods adopted to address the three major challenges of video feature extraction, expression subjectivity, and multimodal feature fusion. We first introduce the widely used emotion representation models in AVCA and describe commonly used datasets. We summarize and compare representative methods in the following aspects: (1) unimodal AVCA models, including facial expression recognition and posture emotion recognition; (2) multimodal AVCA models, including feature fusion, decision fusion, and attention-based multimodal models; (3) model performance evaluation standards. Finally, we discuss future challenges and promising research directions, such as emotion recognition and public opinion analysis, human-computer interaction, and emotional intelligence.
title Affective Video Content Analysis: Decade Review and New Perspectives
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2310.17212