Explainable Facial Expression Recognition for People with Intellectual Disabilities

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Guarinos, Silvia Ramis, Yee, Cristina Manresa, Rubio, Jose Maria Buades, Gaya-Morey, Francesc Xavier
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929348614815744
author Guarinos, Silvia Ramis
Yee, Cristina Manresa
Rubio, Jose Maria Buades
Gaya-Morey, Francesc Xavier
author_facet Guarinos, Silvia Ramis
Yee, Cristina Manresa
Rubio, Jose Maria Buades
Gaya-Morey, Francesc Xavier
contents Facial expression recognition plays an important role in human behaviour, communication, and interaction. Recent neural networks have demonstrated to perform well at its automatic recognition, with different explainability techniques available to make them more transparent. In this work, we propose a facial expression recognition study for people with intellectual disabilities that would be integrated into a social robot. We train two well-known neural networks with five databases of facial expressions and test them with two databases containing people with and without intellectual disabilities. Finally, we study in which regions the models focus to perceive a particular expression using two different explainability techniques: LIME and RISE, assessing the differences when used on images containing disabled and non-disabled people.
format Preprint
id arxiv_https___arxiv_org_abs_2405_11482
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Explainable Facial Expression Recognition for People with Intellectual Disabilities
Guarinos, Silvia Ramis
Yee, Cristina Manresa
Rubio, Jose Maria Buades
Gaya-Morey, Francesc Xavier
Human-Computer Interaction
Facial expression recognition plays an important role in human behaviour, communication, and interaction. Recent neural networks have demonstrated to perform well at its automatic recognition, with different explainability techniques available to make them more transparent. In this work, we propose a facial expression recognition study for people with intellectual disabilities that would be integrated into a social robot. We train two well-known neural networks with five databases of facial expressions and test them with two databases containing people with and without intellectual disabilities. Finally, we study in which regions the models focus to perceive a particular expression using two different explainability techniques: LIME and RISE, assessing the differences when used on images containing disabled and non-disabled people.
title Explainable Facial Expression Recognition for People with Intellectual Disabilities
topic Human-Computer Interaction
url https://arxiv.org/abs/2405.11482