From Risk Avoidance to User Empowerment in AI Mental Health Crisis Support
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914404082122752 |
|---|---|
| author | Kaveladze, Benjamin Ghosh, Arka Ajmani, Leah Ford, Denae Gutierrez, Peter M Hanson, Jetta E Kim, Eugenia Namuduri, Keertana Nguyen, Theresa Okoli, Ebele Rexin, Teresa Schleider, Jessica L Shen, Hongyi Suh, Jina |
| author_facet | Kaveladze, Benjamin Ghosh, Arka Ajmani, Leah Ford, Denae Gutierrez, Peter M Hanson, Jetta E Kim, Eugenia Namuduri, Keertana Nguyen, Theresa Okoli, Ebele Rexin, Teresa Schleider, Jessica L Shen, Hongyi Suh, Jina |
| contents | People experiencing mental health crises frequently turn to open-ended generative AI (GenAI) chatbots for support. However, rather than providing immediate assistance, some GenAI chatbots are designed to respond to crisis situations in ways that minimize their developers' liability, primarily through avoidance (e.g., refusing to engage beyond templated referrals to crisis hotlines). Withholding crisis support in these cases may harm users who have no viable alternatives and reduce their motivation to seek further help. At scale, this avoidant design could undermine population mental health. We propose empowerment-oriented design principles for AI crisis support, informed by community helper models. As an initial touchpoint in help-seeking, AI chatbots can act as a supportive bridge to de-escalate crises and connect users to more reliable care. Coordination between AI developers and regulators can enable a better balance of risk mitigation and user empowerment in AI crisis support. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_05647 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | From Risk Avoidance to User Empowerment in AI Mental Health Crisis Support Kaveladze, Benjamin Ghosh, Arka Ajmani, Leah Ford, Denae Gutierrez, Peter M Hanson, Jetta E Kim, Eugenia Namuduri, Keertana Nguyen, Theresa Okoli, Ebele Rexin, Teresa Schleider, Jessica L Shen, Hongyi Suh, Jina Computers and Society Human-Computer Interaction People experiencing mental health crises frequently turn to open-ended generative AI (GenAI) chatbots for support. However, rather than providing immediate assistance, some GenAI chatbots are designed to respond to crisis situations in ways that minimize their developers' liability, primarily through avoidance (e.g., refusing to engage beyond templated referrals to crisis hotlines). Withholding crisis support in these cases may harm users who have no viable alternatives and reduce their motivation to seek further help. At scale, this avoidant design could undermine population mental health. We propose empowerment-oriented design principles for AI crisis support, informed by community helper models. As an initial touchpoint in help-seeking, AI chatbots can act as a supportive bridge to de-escalate crises and connect users to more reliable care. Coordination between AI developers and regulators can enable a better balance of risk mitigation and user empowerment in AI crisis support. |
| title | From Risk Avoidance to User Empowerment in AI Mental Health Crisis Support |
| topic | Computers and Society Human-Computer Interaction |
| url | https://arxiv.org/abs/2603.05647 |