Saved in:
Bibliographic Details
Main Authors: Banos, Oresti, Comas-González, Zhoe, Medina, Javier, Polo-Rodríguez, Aurora, Gil, David, Peral, Jesús, Amador, Sandra, Villalonga, Claudia
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.04712
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917713722474496
author Banos, Oresti
Comas-González, Zhoe
Medina, Javier
Polo-Rodríguez, Aurora
Gil, David
Peral, Jesús
Amador, Sandra
Villalonga, Claudia
author_facet Banos, Oresti
Comas-González, Zhoe
Medina, Javier
Polo-Rodríguez, Aurora
Gil, David
Peral, Jesús
Amador, Sandra
Villalonga, Claudia
contents Background: Human Emotion Recognition (HER) has been a popular field of study in the past years. Despite the great progresses made so far, relatively little attention has been paid to the use of HER in autism. People with autism are known to face problems with daily social communication and the prototypical interpretation of emotional responses, which are most frequently exerted via facial expressions. This poses significant practical challenges to the application of regular HER systems, which are normally developed for and by neurotypical people. Objective: This study reviews the literature on the use of HER systems in autism, particularly with respect to sensing technologies and machine learning methods, as to identify existing barriers and possible future directions. Methods: We conducted a systematic review of articles published between January 2011 and June 2023 according to the 2020 PRISMA guidelines. Manuscripts were identified through searching Web of Science and Scopus databases. Manuscripts were included when related to emotion recognition, used sensors and machine learning techniques, and involved children with autism, young, or adults. Results: The search yielded 346 articles. A total of 65 publications met the eligibility criteria and were included in the review. Conclusions: Studies predominantly used facial expression techniques as the emotion recognition method. Consequently, video cameras were the most widely used devices across studies, although a growing trend in the use of physiological sensors was observed lately. Happiness, sadness, anger, fear, disgust, and surprise were most frequently addressed. Classical supervised machine learning techniques were primarily used at the expense of unsupervised approaches or more recent deep learning models.
format Preprint
id arxiv_https___arxiv_org_abs_2407_04712
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Sensing technologies and machine learning methods for emotion recognition in autism: Systematic review
Banos, Oresti
Comas-González, Zhoe
Medina, Javier
Polo-Rodríguez, Aurora
Gil, David
Peral, Jesús
Amador, Sandra
Villalonga, Claudia
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Background: Human Emotion Recognition (HER) has been a popular field of study in the past years. Despite the great progresses made so far, relatively little attention has been paid to the use of HER in autism. People with autism are known to face problems with daily social communication and the prototypical interpretation of emotional responses, which are most frequently exerted via facial expressions. This poses significant practical challenges to the application of regular HER systems, which are normally developed for and by neurotypical people. Objective: This study reviews the literature on the use of HER systems in autism, particularly with respect to sensing technologies and machine learning methods, as to identify existing barriers and possible future directions. Methods: We conducted a systematic review of articles published between January 2011 and June 2023 according to the 2020 PRISMA guidelines. Manuscripts were identified through searching Web of Science and Scopus databases. Manuscripts were included when related to emotion recognition, used sensors and machine learning techniques, and involved children with autism, young, or adults. Results: The search yielded 346 articles. A total of 65 publications met the eligibility criteria and were included in the review. Conclusions: Studies predominantly used facial expression techniques as the emotion recognition method. Consequently, video cameras were the most widely used devices across studies, although a growing trend in the use of physiological sensors was observed lately. Happiness, sadness, anger, fear, disgust, and surprise were most frequently addressed. Classical supervised machine learning techniques were primarily used at the expense of unsupervised approaches or more recent deep learning models.
title Sensing technologies and machine learning methods for emotion recognition in autism: Systematic review
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2407.04712