Demystifying Feature Engineering in Malware Analysis of API Call Sequences

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Qu, Tianheng, Zhu, Hongsong, Sun, Limin, Wang, Haining, Fei, Haiqiang, He, Zheng, Li, Zhi
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917116352921600
author Qu, Tianheng
Zhu, Hongsong
Sun, Limin
Wang, Haining
Fei, Haiqiang
He, Zheng
Li, Zhi
author_facet Qu, Tianheng
Zhu, Hongsong
Sun, Limin
Wang, Haining
Fei, Haiqiang
He, Zheng
Li, Zhi
contents Machine learning (ML) has been widely used to analyze API call sequences in malware analysis, which typically requires the expertise of domain specialists to extract relevant features from raw data. The extracted features play a critical role in malware analysis. Traditional feature extraction is based on human domain knowledge, while there is a trend of using natural language processing (NLP) for automatic feature extraction. This raises a question: how do we effectively select features for malware analysis based on API call sequences? To answer it, this paper presents a comprehensive study of investigating the impact of feature engineering upon malware classification.We first conducted a comparative performance evaluation under three models, Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), and Transformer, with respect to knowledge-based and NLP-based feature engineering methods. We observed that models with knowledge-based feature engineering inputs generally outperform those using NLP-based across all metrics, especially under smaller sample sizes. Then we analyzed a complete set of data features from API call sequences, our analysis reveals that models often focus on features such as handles and virtual addresses, which vary across executions and are difficult for human analysts to interpret.
format Preprint
id arxiv_https___arxiv_org_abs_2512_01666
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Demystifying Feature Engineering in Malware Analysis of API Call Sequences
Qu, Tianheng
Zhu, Hongsong
Sun, Limin
Wang, Haining
Fei, Haiqiang
He, Zheng
Li, Zhi
Cryptography and Security
Machine learning (ML) has been widely used to analyze API call sequences in malware analysis, which typically requires the expertise of domain specialists to extract relevant features from raw data. The extracted features play a critical role in malware analysis. Traditional feature extraction is based on human domain knowledge, while there is a trend of using natural language processing (NLP) for automatic feature extraction. This raises a question: how do we effectively select features for malware analysis based on API call sequences? To answer it, this paper presents a comprehensive study of investigating the impact of feature engineering upon malware classification.We first conducted a comparative performance evaluation under three models, Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), and Transformer, with respect to knowledge-based and NLP-based feature engineering methods. We observed that models with knowledge-based feature engineering inputs generally outperform those using NLP-based across all metrics, especially under smaller sample sizes. Then we analyzed a complete set of data features from API call sequences, our analysis reveals that models often focus on features such as handles and virtual addresses, which vary across executions and are difficult for human analysts to interpret.
title Demystifying Feature Engineering in Malware Analysis of API Call Sequences
topic Cryptography and Security
url https://arxiv.org/abs/2512.01666