Guardado en:
Detalles Bibliográficos
Autores principales: Huang, Yuning, Hassan, Mohamed Abul, He, Jiangpeng, Higgins, Janine, McCrory, Megan, Eicher-Miller, Heather, Thomas, Graham, Sazonov, Edward O, Zhu, Fengqing Maggie
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:https://arxiv.org/abs/2405.07827
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917664374390784
author Huang, Yuning
Hassan, Mohamed Abul
He, Jiangpeng
Higgins, Janine
McCrory, Megan
Eicher-Miller, Heather
Thomas, Graham
Sazonov, Edward O
Zhu, Fengqing Maggie
author_facet Huang, Yuning
Hassan, Mohamed Abul
He, Jiangpeng
Higgins, Janine
McCrory, Megan
Eicher-Miller, Heather
Thomas, Graham
Sazonov, Edward O
Zhu, Fengqing Maggie
contents Detecting an ingestion environment is an important aspect of monitoring dietary intake. It provides insightful information for dietary assessment. However, it is a challenging problem where human-based reviewing can be tedious, and algorithm-based review suffers from data imbalance and perceptual aliasing problems. To address these issues, we propose a neural network-based method with a two-stage training framework that tactfully combines fine-tuning and transfer learning techniques. Our method is evaluated on a newly collected dataset called ``UA Free Living Study", which uses an egocentric wearable camera, AIM-2 sensor, to simulate food consumption in free-living conditions. The proposed training framework is applied to common neural network backbones, combined with approaches in the general imbalanced classification field. Experimental results on the collected dataset show that our proposed method for automatic ingestion environment recognition successfully addresses the challenging data imbalance problem in the dataset and achieves a promising overall classification accuracy of 96.63%.
format Preprint
id arxiv_https___arxiv_org_abs_2405_07827
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automatic Recognition of Food Ingestion Environment from the AIM-2 Wearable Sensor
Huang, Yuning
Hassan, Mohamed Abul
He, Jiangpeng
Higgins, Janine
McCrory, Megan
Eicher-Miller, Heather
Thomas, Graham
Sazonov, Edward O
Zhu, Fengqing Maggie
Multimedia
Artificial Intelligence
Computer Vision and Pattern Recognition
Detecting an ingestion environment is an important aspect of monitoring dietary intake. It provides insightful information for dietary assessment. However, it is a challenging problem where human-based reviewing can be tedious, and algorithm-based review suffers from data imbalance and perceptual aliasing problems. To address these issues, we propose a neural network-based method with a two-stage training framework that tactfully combines fine-tuning and transfer learning techniques. Our method is evaluated on a newly collected dataset called ``UA Free Living Study", which uses an egocentric wearable camera, AIM-2 sensor, to simulate food consumption in free-living conditions. The proposed training framework is applied to common neural network backbones, combined with approaches in the general imbalanced classification field. Experimental results on the collected dataset show that our proposed method for automatic ingestion environment recognition successfully addresses the challenging data imbalance problem in the dataset and achieves a promising overall classification accuracy of 96.63%.
title Automatic Recognition of Food Ingestion Environment from the AIM-2 Wearable Sensor
topic Multimedia
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.07827