Dietary Intake Estimation via Continuous 3D Reconstruction of Food

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lee, Wallace, Chen, YuHao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908344724226048
author Lee, Wallace
Chen, YuHao
author_facet Lee, Wallace
Chen, YuHao
contents Monitoring dietary habits is crucial for preventing health risks associated with overeating and undereating, including obesity, diabetes, and cardiovascular diseases. Traditional methods for tracking food intake rely on self-reported data before or after the eating, which are prone to inaccuracies. This study proposes an approach to accurately monitor ingest behaviours by leveraging 3D food models constructed from monocular 2D video. Using COLMAP and pose estimation algorithms, we generate detailed 3D representations of food, allowing us to observe changes in food volume as it is consumed. Experiments with toy models and real food items demonstrate the approach's potential. Meanwhile, we have proposed a new methodology for automated state recognition challenges to accurately detect state changes and maintain model fidelity. The 3D reconstruction approach shows promise in capturing comprehensive dietary behaviour insights, ultimately contributing to the development of automated and accurate dietary monitoring tools.
format Preprint
id arxiv_https___arxiv_org_abs_2505_00606
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Dietary Intake Estimation via Continuous 3D Reconstruction of Food
Lee, Wallace
Chen, YuHao
Computer Vision and Pattern Recognition
Machine Learning
Monitoring dietary habits is crucial for preventing health risks associated with overeating and undereating, including obesity, diabetes, and cardiovascular diseases. Traditional methods for tracking food intake rely on self-reported data before or after the eating, which are prone to inaccuracies. This study proposes an approach to accurately monitor ingest behaviours by leveraging 3D food models constructed from monocular 2D video. Using COLMAP and pose estimation algorithms, we generate detailed 3D representations of food, allowing us to observe changes in food volume as it is consumed. Experiments with toy models and real food items demonstrate the approach's potential. Meanwhile, we have proposed a new methodology for automated state recognition challenges to accurately detect state changes and maintain model fidelity. The 3D reconstruction approach shows promise in capturing comprehensive dietary behaviour insights, ultimately contributing to the development of automated and accurate dietary monitoring tools.
title Dietary Intake Estimation via Continuous 3D Reconstruction of Food
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2505.00606