Saved in:
Bibliographic Details
Main Authors: Murtada, Amna, Abdelrhman, Omnia, Attia, Tahani Abdalla
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2501.18538
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913671373914112
author Murtada, Amna
Abdelrhman, Omnia
Attia, Tahani Abdalla
author_facet Murtada, Amna
Abdelrhman, Omnia
Attia, Tahani Abdalla
contents Facial Emotion Recognition has emerged as increasingly pivotal in the domain of User Experience, notably within modern usability testing, as it facilitates a deeper comprehension of user satisfaction and engagement. This study aims to extend the ResEmoteNet model by employing a knowledge distillation framework to develop Mini-ResEmoteNet models - lightweight student models - tailored for usability testing. Experiments were conducted on the FER2013 and RAF-DB datasets to assess the efficacy of three student model architectures: Student Model A, Student Model B, and Student Model C. Their development involves reducing the number of feature channels in each layer of the teacher model by approximately 50%, 75%, and 87.5%. Demonstrating exceptional performance on the FER2013 dataset, Student Model A (E1) achieved a test accuracy of 76.33%, marking a 0.21% absolute improvement over EmoNeXt. Moreover, the results exhibit absolute improvements in terms of inference speed and memory usage during inference compared to the ResEmoteNet model. The findings indicate that the proposed methods surpass other state-of-the-art approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2501_18538
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Mini-ResEmoteNet: Leveraging Knowledge Distillation for Human-Centered Design
Murtada, Amna
Abdelrhman, Omnia
Attia, Tahani Abdalla
Computer Vision and Pattern Recognition
Facial Emotion Recognition has emerged as increasingly pivotal in the domain of User Experience, notably within modern usability testing, as it facilitates a deeper comprehension of user satisfaction and engagement. This study aims to extend the ResEmoteNet model by employing a knowledge distillation framework to develop Mini-ResEmoteNet models - lightweight student models - tailored for usability testing. Experiments were conducted on the FER2013 and RAF-DB datasets to assess the efficacy of three student model architectures: Student Model A, Student Model B, and Student Model C. Their development involves reducing the number of feature channels in each layer of the teacher model by approximately 50%, 75%, and 87.5%. Demonstrating exceptional performance on the FER2013 dataset, Student Model A (E1) achieved a test accuracy of 76.33%, marking a 0.21% absolute improvement over EmoNeXt. Moreover, the results exhibit absolute improvements in terms of inference speed and memory usage during inference compared to the ResEmoteNet model. The findings indicate that the proposed methods surpass other state-of-the-art approaches.
title Mini-ResEmoteNet: Leveraging Knowledge Distillation for Human-Centered Design
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.18538