Saved in:
Bibliographic Details
Main Authors: Khandelwal, Yash, Arvind, Mayur, Kumar, Sriram, Gupta, Ashish, Danisetty, Sachin Kumar, Bagad, Piyush, Madan, Anish, Lunayach, Mayank, Annavajjala, Aditya, Maiti, Abhishek, Jain, Sansiddh, Dalmia, Aman, Deka, Namrata, White, Jerome, Doshi, Jigar, Kanazawa, Angjoo, Panicker, Rahul, Raval, Alpan, Rana, Srinivas, Tapaswi, Makarand
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.05530
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916239888089088
author Khandelwal, Yash
Arvind, Mayur
Kumar, Sriram
Gupta, Ashish
Danisetty, Sachin Kumar
Bagad, Piyush
Madan, Anish
Lunayach, Mayank
Annavajjala, Aditya
Maiti, Abhishek
Jain, Sansiddh
Dalmia, Aman
Deka, Namrata
White, Jerome
Doshi, Jigar
Kanazawa, Angjoo
Panicker, Rahul
Raval, Alpan
Rana, Srinivas
Tapaswi, Makarand
author_facet Khandelwal, Yash
Arvind, Mayur
Kumar, Sriram
Gupta, Ashish
Danisetty, Sachin Kumar
Bagad, Piyush
Madan, Anish
Lunayach, Mayank
Annavajjala, Aditya
Maiti, Abhishek
Jain, Sansiddh
Dalmia, Aman
Deka, Namrata
White, Jerome
Doshi, Jigar
Kanazawa, Angjoo
Panicker, Rahul
Raval, Alpan
Rana, Srinivas
Tapaswi, Makarand
contents Malnutrition among newborns is a top public health concern in developing countries. Identification and subsequent growth monitoring are key to successful interventions. However, this is challenging in rural communities where health systems tend to be inaccessible and under-equipped, with poor adherence to protocol. Our goal is to equip health workers and public health systems with a solution for contactless newborn anthropometry in the community. We propose NurtureNet, a multi-task model that fuses visual information (a video taken with a low-cost smartphone) with tabular inputs to regress multiple anthropometry estimates including weight, length, head circumference, and chest circumference. We show that visual proxy tasks of segmentation and keypoint prediction further improve performance. We establish the efficacy of the model through several experiments and achieve a relative error of 3.9% and mean absolute error of 114.3 g for weight estimation. Model compression to 15 MB also allows offline deployment to low-cost smartphones.
format Preprint
id arxiv_https___arxiv_org_abs_2405_05530
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle NurtureNet: A Multi-task Video-based Approach for Newborn Anthropometry
Khandelwal, Yash
Arvind, Mayur
Kumar, Sriram
Gupta, Ashish
Danisetty, Sachin Kumar
Bagad, Piyush
Madan, Anish
Lunayach, Mayank
Annavajjala, Aditya
Maiti, Abhishek
Jain, Sansiddh
Dalmia, Aman
Deka, Namrata
White, Jerome
Doshi, Jigar
Kanazawa, Angjoo
Panicker, Rahul
Raval, Alpan
Rana, Srinivas
Tapaswi, Makarand
Computer Vision and Pattern Recognition
Malnutrition among newborns is a top public health concern in developing countries. Identification and subsequent growth monitoring are key to successful interventions. However, this is challenging in rural communities where health systems tend to be inaccessible and under-equipped, with poor adherence to protocol. Our goal is to equip health workers and public health systems with a solution for contactless newborn anthropometry in the community. We propose NurtureNet, a multi-task model that fuses visual information (a video taken with a low-cost smartphone) with tabular inputs to regress multiple anthropometry estimates including weight, length, head circumference, and chest circumference. We show that visual proxy tasks of segmentation and keypoint prediction further improve performance. We establish the efficacy of the model through several experiments and achieve a relative error of 3.9% and mean absolute error of 114.3 g for weight estimation. Model compression to 15 MB also allows offline deployment to low-cost smartphones.
title NurtureNet: A Multi-task Video-based Approach for Newborn Anthropometry
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.05530