MetaFood3D: 3D Food Dataset with Nutrition Values
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917860681449472 |
|---|---|
| author | Chen, Yuhao He, Jiangpeng Vinod, Gautham Raghavan, Siddeshwar Czarnecki, Chris Ma, Jinge Mahmud, Talha Ibn Coburn, Bruce Mao, Dayou Nair, Saeejith Xi, Pengcheng Wong, Alexander Delp, Edward Zhu, Fengqing |
| author_facet | Chen, Yuhao He, Jiangpeng Vinod, Gautham Raghavan, Siddeshwar Czarnecki, Chris Ma, Jinge Mahmud, Talha Ibn Coburn, Bruce Mao, Dayou Nair, Saeejith Xi, Pengcheng Wong, Alexander Delp, Edward Zhu, Fengqing |
| contents | Food computing is both important and challenging in computer vision (CV). It significantly contributes to the development of CV algorithms due to its frequent presence in datasets across various applications, ranging from classification and instance segmentation to 3D reconstruction. The polymorphic shapes and textures of food, coupled with high variation in forms and vast multimodal information, including language descriptions and nutritional data, make food computing a complex and demanding task for modern CV algorithms. 3D food modeling is a new frontier for addressing food related problems, due to its inherent capability to deal with random camera views and its straightforward representation for calculating food portion size. However, the primary hurdle in the development of algorithms for food object analysis is the lack of nutrition values in existing 3D datasets. Moreover, in the broader field of 3D research, there is a critical need for domain-specific test datasets. To bridge the gap between general 3D vision and food computing research, we introduce MetaFood3D. This dataset consists of 743 meticulously scanned and labeled 3D food objects across 131 categories, featuring detailed nutrition information, weight, and food codes linked to a comprehensive nutrition database. Our MetaFood3D dataset emphasizes intra-class diversity and includes rich modalities such as textured mesh files, RGB-D videos, and segmentation masks. Experimental results demonstrate our dataset's strong capabilities in enhancing food portion estimation algorithms, highlight the gap between video captures and 3D scanned data, and showcase the strengths of MetaFood3D in generating synthetic eating occasion data and 3D food objects. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_01966 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MetaFood3D: 3D Food Dataset with Nutrition Values Chen, Yuhao He, Jiangpeng Vinod, Gautham Raghavan, Siddeshwar Czarnecki, Chris Ma, Jinge Mahmud, Talha Ibn Coburn, Bruce Mao, Dayou Nair, Saeejith Xi, Pengcheng Wong, Alexander Delp, Edward Zhu, Fengqing Computer Vision and Pattern Recognition Food computing is both important and challenging in computer vision (CV). It significantly contributes to the development of CV algorithms due to its frequent presence in datasets across various applications, ranging from classification and instance segmentation to 3D reconstruction. The polymorphic shapes and textures of food, coupled with high variation in forms and vast multimodal information, including language descriptions and nutritional data, make food computing a complex and demanding task for modern CV algorithms. 3D food modeling is a new frontier for addressing food related problems, due to its inherent capability to deal with random camera views and its straightforward representation for calculating food portion size. However, the primary hurdle in the development of algorithms for food object analysis is the lack of nutrition values in existing 3D datasets. Moreover, in the broader field of 3D research, there is a critical need for domain-specific test datasets. To bridge the gap between general 3D vision and food computing research, we introduce MetaFood3D. This dataset consists of 743 meticulously scanned and labeled 3D food objects across 131 categories, featuring detailed nutrition information, weight, and food codes linked to a comprehensive nutrition database. Our MetaFood3D dataset emphasizes intra-class diversity and includes rich modalities such as textured mesh files, RGB-D videos, and segmentation masks. Experimental results demonstrate our dataset's strong capabilities in enhancing food portion estimation algorithms, highlight the gap between video captures and 3D scanned data, and showcase the strengths of MetaFood3D in generating synthetic eating occasion data and 3D food objects. |
| title | MetaFood3D: 3D Food Dataset with Nutrition Values |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.01966 |