Scaling Up: Revisiting Mining Android Sandboxes at Scale for Malware Classification

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Costa, Francisco, Medeiros, Ismael, Oliveira, Leandro, Calássio, João, Bonifácio, Rodrigo, Narasimhan, Krishna, Mezini, Mira, Ribeiro, Márcio
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912376155013120
author Costa, Francisco
Medeiros, Ismael
Oliveira, Leandro
Calássio, João
Bonifácio, Rodrigo
Narasimhan, Krishna
Mezini, Mira
Ribeiro, Márcio
author_facet Costa, Francisco
Medeiros, Ismael
Oliveira, Leandro
Calássio, João
Bonifácio, Rodrigo
Narasimhan, Krishna
Mezini, Mira
Ribeiro, Márcio
contents The widespread use of smartphones in daily life has raised concerns about privacy and security among researchers and practitioners. Privacy issues are generally highly prevalent in mobile applications, particularly targeting the Android platform, the most popular mobile operating system. For this reason, several techniques have been proposed to identify malicious behavior in Android applications, including the Mining Android Sandbox approach (MAS approach), which aims to identify malicious behavior in repackaged Android applications (apps). However, previous empirical studies evaluated the MAS approach using a small dataset consisting of only 102 pairs of original and repackaged apps. This limitation raises questions about the external validity of their findings and whether the MAS approach can be generalized to larger datasets. To address these concerns, this paper presents the results of a replication study focused on evaluating the performance of the MAS approach regarding its capabilities of correctly classifying malware from different families. Unlike previous studies, our research employs a dataset that is an order of magnitude larger, comprising 4,076 pairs of apps covering a more diverse range of Android malware families. Surprisingly, our findings indicate a poor performance of the MAS approach for identifying malware, with the F1-score decreasing from 0.90 for the small dataset used in the previous studies to 0.54 in our more extensive dataset. Upon closer examination, we discovered that certain malware families partially account for the low accuracy of the MAS approach, which fails to classify a repackaged version of an app as malware correctly. Our findings highlight the limitations of the MAS approach, particularly when scaled, and underscore the importance of complementing it with other techniques to detect a broader range of malware effectively.
format Preprint
id arxiv_https___arxiv_org_abs_2505_09501
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Scaling Up: Revisiting Mining Android Sandboxes at Scale for Malware Classification
Costa, Francisco
Medeiros, Ismael
Oliveira, Leandro
Calássio, João
Bonifácio, Rodrigo
Narasimhan, Krishna
Mezini, Mira
Ribeiro, Márcio
Cryptography and Security
The widespread use of smartphones in daily life has raised concerns about privacy and security among researchers and practitioners. Privacy issues are generally highly prevalent in mobile applications, particularly targeting the Android platform, the most popular mobile operating system. For this reason, several techniques have been proposed to identify malicious behavior in Android applications, including the Mining Android Sandbox approach (MAS approach), which aims to identify malicious behavior in repackaged Android applications (apps). However, previous empirical studies evaluated the MAS approach using a small dataset consisting of only 102 pairs of original and repackaged apps. This limitation raises questions about the external validity of their findings and whether the MAS approach can be generalized to larger datasets. To address these concerns, this paper presents the results of a replication study focused on evaluating the performance of the MAS approach regarding its capabilities of correctly classifying malware from different families. Unlike previous studies, our research employs a dataset that is an order of magnitude larger, comprising 4,076 pairs of apps covering a more diverse range of Android malware families. Surprisingly, our findings indicate a poor performance of the MAS approach for identifying malware, with the F1-score decreasing from 0.90 for the small dataset used in the previous studies to 0.54 in our more extensive dataset. Upon closer examination, we discovered that certain malware families partially account for the low accuracy of the MAS approach, which fails to classify a repackaged version of an app as malware correctly. Our findings highlight the limitations of the MAS approach, particularly when scaled, and underscore the importance of complementing it with other techniques to detect a broader range of malware effectively.
title Scaling Up: Revisiting Mining Android Sandboxes at Scale for Malware Classification
topic Cryptography and Security
url https://arxiv.org/abs/2505.09501