On the Abuse and Detection of Polyglot Files

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Koch, Luke, Oesch, Sean, Chaulagain, Amul, Dixon, Jared, Dixon, Matthew, Huettal, Mike, Sadovnik, Amir, Watson, Cory, Weber, Brian, Hartman, Jacob, Patulski, Richard
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913411984523264
author Koch, Luke
Oesch, Sean
Chaulagain, Amul
Dixon, Jared
Dixon, Matthew
Huettal, Mike
Sadovnik, Amir
Watson, Cory
Weber, Brian
Hartman, Jacob
Patulski, Richard
author_facet Koch, Luke
Oesch, Sean
Chaulagain, Amul
Dixon, Jared
Dixon, Matthew
Huettal, Mike
Sadovnik, Amir
Watson, Cory
Weber, Brian
Hartman, Jacob
Patulski, Richard
contents A polyglot is a file that is valid in two or more formats. Polyglot files pose a problem for malware detection systems that route files to format-specific detectors/signatures, as well as file upload and sanitization tools. In this work we found that existing file-format and embedded-file detection tools, even those developed specifically for polyglot files, fail to reliably detect polyglot files used in the wild, leaving organizations vulnerable to attack. To address this issue, we studied the use of polyglot files by malicious actors in the wild, finding $30$ polyglot samples and $15$ attack chains that leveraged polyglot files. In this report, we highlight two well-known APTs whose cyber attack chains relied on polyglot files to bypass detection mechanisms. Using knowledge from our survey of polyglot usage in the wild -- the first of its kind -- we created a novel data set based on adversary techniques. We then trained a machine learning detection solution, PolyConv, using this data set. PolyConv achieves a precision-recall area-under-curve score of $0.999$ with an F1 score of $99.20$% for polyglot detection and $99.47$% for file-format identification, significantly outperforming all other tools tested. We developed a content disarmament and reconstruction tool, ImSan, that successfully sanitized $100$% of the tested image-based polyglots, which were the most common type found via the survey. Our work provides concrete tools and suggestions to enable defenders to better defend themselves against polyglot files, as well as directions for future work to create more robust file specifications and methods of disarmament.
format Preprint
id arxiv_https___arxiv_org_abs_2407_01529
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On the Abuse and Detection of Polyglot Files
Koch, Luke
Oesch, Sean
Chaulagain, Amul
Dixon, Jared
Dixon, Matthew
Huettal, Mike
Sadovnik, Amir
Watson, Cory
Weber, Brian
Hartman, Jacob
Patulski, Richard
Cryptography and Security
Machine Learning
A polyglot is a file that is valid in two or more formats. Polyglot files pose a problem for malware detection systems that route files to format-specific detectors/signatures, as well as file upload and sanitization tools. In this work we found that existing file-format and embedded-file detection tools, even those developed specifically for polyglot files, fail to reliably detect polyglot files used in the wild, leaving organizations vulnerable to attack. To address this issue, we studied the use of polyglot files by malicious actors in the wild, finding $30$ polyglot samples and $15$ attack chains that leveraged polyglot files. In this report, we highlight two well-known APTs whose cyber attack chains relied on polyglot files to bypass detection mechanisms. Using knowledge from our survey of polyglot usage in the wild -- the first of its kind -- we created a novel data set based on adversary techniques. We then trained a machine learning detection solution, PolyConv, using this data set. PolyConv achieves a precision-recall area-under-curve score of $0.999$ with an F1 score of $99.20$% for polyglot detection and $99.47$% for file-format identification, significantly outperforming all other tools tested. We developed a content disarmament and reconstruction tool, ImSan, that successfully sanitized $100$% of the tested image-based polyglots, which were the most common type found via the survey. Our work provides concrete tools and suggestions to enable defenders to better defend themselves against polyglot files, as well as directions for future work to create more robust file specifications and methods of disarmament.
title On the Abuse and Detection of Polyglot Files
topic Cryptography and Security
Machine Learning
url https://arxiv.org/abs/2407.01529