LM-Scout: Analyzing the Security of Language Model Integration in Android Apps

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ibrahim, Muhammad, Tuncay, Gűliz Seray, Celik, Z. Berkay, Machiry, Aravind, Bianchi, Antonio
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916735000510464
author Ibrahim, Muhammad
Tuncay, Gűliz Seray
Celik, Z. Berkay
Machiry, Aravind
Bianchi, Antonio
author_facet Ibrahim, Muhammad
Tuncay, Gűliz Seray
Celik, Z. Berkay
Machiry, Aravind
Bianchi, Antonio
contents Developers are increasingly integrating Language Models (LMs) into their mobile apps to provide features such as chat-based assistants. To prevent LM misuse, they impose various restrictions, including limits on the number of queries, input length, and allowed topics. However, if the LM integration is insecure, attackers can bypass these restrictions and gain unrestricted access to the LM, potentially harming developers' reputations and leading to significant financial losses. This paper presents the first systematic study of insecure usage of LMs by Android apps. We first manually analyze a preliminary dataset of apps to investigate LM integration methods, construct a taxonomy that categorizes the LM usage restrictions implemented by the apps, and determine how to bypass them. Alarmingly, we can bypass restrictions in 127 out of 181 apps. Then, we develop LM-Scout, a fully automated tool to detect on a large-scale vulnerable usage of LMs in 2,950 mobile apps. LM-Scout shows that, in many cases (i.e., 120 apps), it is possible to find and exploit such security issues automatically. Finally, we identify the root causes for the identified issues and offer recommendations for secure LM integration.
format Preprint
id arxiv_https___arxiv_org_abs_2505_08204
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LM-Scout: Analyzing the Security of Language Model Integration in Android Apps
Ibrahim, Muhammad
Tuncay, Gűliz Seray
Celik, Z. Berkay
Machiry, Aravind
Bianchi, Antonio
Cryptography and Security
Developers are increasingly integrating Language Models (LMs) into their mobile apps to provide features such as chat-based assistants. To prevent LM misuse, they impose various restrictions, including limits on the number of queries, input length, and allowed topics. However, if the LM integration is insecure, attackers can bypass these restrictions and gain unrestricted access to the LM, potentially harming developers' reputations and leading to significant financial losses. This paper presents the first systematic study of insecure usage of LMs by Android apps. We first manually analyze a preliminary dataset of apps to investigate LM integration methods, construct a taxonomy that categorizes the LM usage restrictions implemented by the apps, and determine how to bypass them. Alarmingly, we can bypass restrictions in 127 out of 181 apps. Then, we develop LM-Scout, a fully automated tool to detect on a large-scale vulnerable usage of LMs in 2,950 mobile apps. LM-Scout shows that, in many cases (i.e., 120 apps), it is possible to find and exploit such security issues automatically. Finally, we identify the root causes for the identified issues and offer recommendations for secure LM integration.
title LM-Scout: Analyzing the Security of Language Model Integration in Android Apps
topic Cryptography and Security
url https://arxiv.org/abs/2505.08204