Decoding User Concerns in AI Health Chatbots: An Exploration of Security and Privacy in App Reviews
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916593369350144 |
|---|---|
| author | Hassan, Muhammad Ghani, Abdullah Zaffar, Muhammad Fareed Bashir, Masooda |
| author_facet | Hassan, Muhammad Ghani, Abdullah Zaffar, Muhammad Fareed Bashir, Masooda |
| contents | AI powered health chatbot applications are increasingly utilized for personalized healthcare services, yet they pose significant challenges related to user data security and privacy. This study evaluates the effectiveness of automated methods, specifically BART and Gemini GenAI, in identifying security privacy related (SPR) concerns within these applications' user reviews, benchmarking their performance against manual qualitative analysis. Our results indicate that while Gemini's performance in SPR classification is comparable to manual labeling, both automated methods have limitations, including the misclassification of unrelated issues. Qualitative analysis revealed critical user concerns, such as data collection practices, data misuse, and insufficient transparency and consent mechanisms. This research enhances the understanding of the relationship between user trust, privacy, and emerging mobile AI health chatbot technologies, offering actionable insights for improving security and privacy practices in AI driven health chatbots. Although exploratory, our findings highlight the necessity for rigorous audits and transparent communication strategies, providing valuable guidance for app developers and vendors in addressing user security and privacy concerns. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_00067 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Decoding User Concerns in AI Health Chatbots: An Exploration of Security and Privacy in App Reviews Hassan, Muhammad Ghani, Abdullah Zaffar, Muhammad Fareed Bashir, Masooda Cryptography and Security Emerging Technologies Human-Computer Interaction AI powered health chatbot applications are increasingly utilized for personalized healthcare services, yet they pose significant challenges related to user data security and privacy. This study evaluates the effectiveness of automated methods, specifically BART and Gemini GenAI, in identifying security privacy related (SPR) concerns within these applications' user reviews, benchmarking their performance against manual qualitative analysis. Our results indicate that while Gemini's performance in SPR classification is comparable to manual labeling, both automated methods have limitations, including the misclassification of unrelated issues. Qualitative analysis revealed critical user concerns, such as data collection practices, data misuse, and insufficient transparency and consent mechanisms. This research enhances the understanding of the relationship between user trust, privacy, and emerging mobile AI health chatbot technologies, offering actionable insights for improving security and privacy practices in AI driven health chatbots. Although exploratory, our findings highlight the necessity for rigorous audits and transparent communication strategies, providing valuable guidance for app developers and vendors in addressing user security and privacy concerns. |
| title | Decoding User Concerns in AI Health Chatbots: An Exploration of Security and Privacy in App Reviews |
| topic | Cryptography and Security Emerging Technologies Human-Computer Interaction |
| url | https://arxiv.org/abs/2502.00067 |