MoodCapture: Depression Detection Using In-the-Wild Smartphone Images
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916138456186880 |
|---|---|
| author | Nepal, Subigya Pillai, Arvind Wang, Weichen Griffin, Tess Collins, Amanda C. Heinz, Michael Lekkas, Damien Mirjafari, Shayan Nemesure, Matthew Price, George Jacobson, Nicholas C. Campbell, Andrew T. |
| author_facet | Nepal, Subigya Pillai, Arvind Wang, Weichen Griffin, Tess Collins, Amanda C. Heinz, Michael Lekkas, Damien Mirjafari, Shayan Nemesure, Matthew Price, George Jacobson, Nicholas C. Campbell, Andrew T. |
| contents | MoodCapture presents a novel approach that assesses depression based on images automatically captured from the front-facing camera of smartphones as people go about their daily lives. We collect over 125,000 photos in the wild from N=177 participants diagnosed with major depressive disorder for 90 days. Images are captured naturalistically while participants respond to the PHQ-8 depression survey question: \textit{``I have felt down, depressed, or hopeless''}. Our analysis explores important image attributes, such as angle, dominant colors, location, objects, and lighting. We show that a random forest trained with face landmarks can classify samples as depressed or non-depressed and predict raw PHQ-8 scores effectively. Our post-hoc analysis provides several insights through an ablation study, feature importance analysis, and bias assessment. Importantly, we evaluate user concerns about using MoodCapture to detect depression based on sharing photos, providing critical insights into privacy concerns that inform the future design of in-the-wild image-based mental health assessment tools. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_16182 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MoodCapture: Depression Detection Using In-the-Wild Smartphone Images Nepal, Subigya Pillai, Arvind Wang, Weichen Griffin, Tess Collins, Amanda C. Heinz, Michael Lekkas, Damien Mirjafari, Shayan Nemesure, Matthew Price, George Jacobson, Nicholas C. Campbell, Andrew T. Human-Computer Interaction Computer Vision and Pattern Recognition H.5.0; H.5.3; H.5.m; J.0 MoodCapture presents a novel approach that assesses depression based on images automatically captured from the front-facing camera of smartphones as people go about their daily lives. We collect over 125,000 photos in the wild from N=177 participants diagnosed with major depressive disorder for 90 days. Images are captured naturalistically while participants respond to the PHQ-8 depression survey question: \textit{``I have felt down, depressed, or hopeless''}. Our analysis explores important image attributes, such as angle, dominant colors, location, objects, and lighting. We show that a random forest trained with face landmarks can classify samples as depressed or non-depressed and predict raw PHQ-8 scores effectively. Our post-hoc analysis provides several insights through an ablation study, feature importance analysis, and bias assessment. Importantly, we evaluate user concerns about using MoodCapture to detect depression based on sharing photos, providing critical insights into privacy concerns that inform the future design of in-the-wild image-based mental health assessment tools. |
| title | MoodCapture: Depression Detection Using In-the-Wild Smartphone Images |
| topic | Human-Computer Interaction Computer Vision and Pattern Recognition H.5.0; H.5.3; H.5.m; J.0 |
| url | https://arxiv.org/abs/2402.16182 |