VolE: A Point-cloud Framework for Food 3D Reconstruction and Volume Estimation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913839267708928 |
|---|---|
| author | Haroon, Umair AlMughrabi, Ahmad Zoumpekas, Thanasis Marques, Ricardo Radeva, Petia |
| author_facet | Haroon, Umair AlMughrabi, Ahmad Zoumpekas, Thanasis Marques, Ricardo Radeva, Petia |
| contents | Accurate food volume estimation is crucial for medical nutrition management and health monitoring applications, but current food volume estimation methods are often limited by mononuclear data, leveraging single-purpose hardware such as 3D scanners, gathering sensor-oriented information such as depth information, or relying on camera calibration using a reference object. In this paper, we present VolE, a novel framework that leverages mobile device-driven 3D reconstruction to estimate food volume. VolE captures images and camera locations in free motion to generate precise 3D models, thanks to AR-capable mobile devices. To achieve real-world measurement, VolE is a reference- and depth-free framework that leverages food video segmentation for food mask generation. We also introduce a new food dataset encompassing the challenging scenarios absent in the previous benchmarks. Our experiments demonstrate that VolE outperforms the existing volume estimation techniques across multiple datasets by achieving 2.22 % MAPE, highlighting its superior performance in food volume estimation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_10205 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | VolE: A Point-cloud Framework for Food 3D Reconstruction and Volume Estimation Haroon, Umair AlMughrabi, Ahmad Zoumpekas, Thanasis Marques, Ricardo Radeva, Petia Computer Vision and Pattern Recognition Accurate food volume estimation is crucial for medical nutrition management and health monitoring applications, but current food volume estimation methods are often limited by mononuclear data, leveraging single-purpose hardware such as 3D scanners, gathering sensor-oriented information such as depth information, or relying on camera calibration using a reference object. In this paper, we present VolE, a novel framework that leverages mobile device-driven 3D reconstruction to estimate food volume. VolE captures images and camera locations in free motion to generate precise 3D models, thanks to AR-capable mobile devices. To achieve real-world measurement, VolE is a reference- and depth-free framework that leverages food video segmentation for food mask generation. We also introduce a new food dataset encompassing the challenging scenarios absent in the previous benchmarks. Our experiments demonstrate that VolE outperforms the existing volume estimation techniques across multiple datasets by achieving 2.22 % MAPE, highlighting its superior performance in food volume estimation. |
| title | VolE: A Point-cloud Framework for Food 3D Reconstruction and Volume Estimation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2505.10205 |