MeciFace: Mechanomyography and Inertial Fusion-based Glasses for Edge Real-Time Recognition of Facial and Eating Activities

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Bello, Hymalai, Suh, Sungho, Zhou, Bo, Lukowicz, Paul
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915079134380032
author Bello, Hymalai
Suh, Sungho
Zhou, Bo
Lukowicz, Paul
author_facet Bello, Hymalai
Suh, Sungho
Zhou, Bo
Lukowicz, Paul
contents The increasing prevalence of stress-related eating behaviors and their impact on overall health highlights the importance of effective and ubiquitous monitoring systems. In this paper, we present MeciFace, an innovative wearable technology designed to monitor facial expressions and eating activities in real-time on-the-edge (RTE). MeciFace aims to provide a low-power, privacy-conscious, and highly accurate tool for promoting healthy eating behaviors and stress management. We employ lightweight convolutional neural networks as backbone models for facial expression and eating monitoring scenarios. The MeciFace system ensures efficient data processing with a tiny memory footprint, ranging from 11KB to 19 KB. During RTE evaluation, the system achieves an F1-score of < 86% for facial expression recognition and 94% for eating/drinking monitoring, for the RTE of unseen users (user-independent case).
format Preprint
id arxiv_https___arxiv_org_abs_2306_13674
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle MeciFace: Mechanomyography and Inertial Fusion-based Glasses for Edge Real-Time Recognition of Facial and Eating Activities
Bello, Hymalai
Suh, Sungho
Zhou, Bo
Lukowicz, Paul
Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
Signal Processing
The increasing prevalence of stress-related eating behaviors and their impact on overall health highlights the importance of effective and ubiquitous monitoring systems. In this paper, we present MeciFace, an innovative wearable technology designed to monitor facial expressions and eating activities in real-time on-the-edge (RTE). MeciFace aims to provide a low-power, privacy-conscious, and highly accurate tool for promoting healthy eating behaviors and stress management. We employ lightweight convolutional neural networks as backbone models for facial expression and eating monitoring scenarios. The MeciFace system ensures efficient data processing with a tiny memory footprint, ranging from 11KB to 19 KB. During RTE evaluation, the system achieves an F1-score of < 86% for facial expression recognition and 94% for eating/drinking monitoring, for the RTE of unseen users (user-independent case).
title MeciFace: Mechanomyography and Inertial Fusion-based Glasses for Edge Real-Time Recognition of Facial and Eating Activities
topic Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
Signal Processing
url https://arxiv.org/abs/2306.13674