Detecting Avalanche Effect in Adversarial Settings: Spotting the Encryption Loops in Ransomware

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Luo, Nanqing, Li, Xusheng, Wang, Haizhou, Zhu, Shuangyi, Ma, Yuan, Liu, Peng
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917439228346368
author Luo, Nanqing
Li, Xusheng
Wang, Haizhou
Zhu, Shuangyi
Ma, Yuan
Liu, Peng
author_facet Luo, Nanqing
Li, Xusheng
Wang, Haizhou
Zhu, Shuangyi
Ma, Yuan
Liu, Peng
contents Spotting encryption loops in binary-only ransomware is a critical reverse engineering task. Since the existence of avalanche effect, an intrinsic characteristic of any secure encryption algorithms, is unavoidable during a victim data encryption attack, it is a very promising direction to spot encryption loops through avalanche effect detection. Unfortunately, no existing work in this direction ensures that the being-checked effect is the avalanche effect itself. Although CipherXRay is inspired by avalanche effect, it only checks whether a "ripple effect" (i.e., a necessary but non-sufficient condition) of avalanche effect exists, allowing a straightforward counterattack to succeed. In this work, we present a new approach that checks the avalanche effect itself. Because the detection is conducted in adversarial settings (e.g., the ransomware author may obfuscate the code), a viable approach must tolerate inaccurate input \& output identification and must be resilient to adversarial evasion. These challenges are addressed by a novel record-and-replay detection mechanism that takes advantage of the statistical guarantees provided by the Shapiro-Wilk normality test. The experimental results show that our approach achieves 0.0\% false negative rate and 1.1\% false positive rate. When our tool is employed to reverse engineer real-world ransomware samples, it succeeds in analyzing all the ransomware samples selected from ten representative families.
format Preprint
id arxiv_https___arxiv_org_abs_2604_24131
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Detecting Avalanche Effect in Adversarial Settings: Spotting the Encryption Loops in Ransomware
Luo, Nanqing
Li, Xusheng
Wang, Haizhou
Zhu, Shuangyi
Ma, Yuan
Liu, Peng
Cryptography and Security
Spotting encryption loops in binary-only ransomware is a critical reverse engineering task. Since the existence of avalanche effect, an intrinsic characteristic of any secure encryption algorithms, is unavoidable during a victim data encryption attack, it is a very promising direction to spot encryption loops through avalanche effect detection. Unfortunately, no existing work in this direction ensures that the being-checked effect is the avalanche effect itself. Although CipherXRay is inspired by avalanche effect, it only checks whether a "ripple effect" (i.e., a necessary but non-sufficient condition) of avalanche effect exists, allowing a straightforward counterattack to succeed. In this work, we present a new approach that checks the avalanche effect itself. Because the detection is conducted in adversarial settings (e.g., the ransomware author may obfuscate the code), a viable approach must tolerate inaccurate input \& output identification and must be resilient to adversarial evasion. These challenges are addressed by a novel record-and-replay detection mechanism that takes advantage of the statistical guarantees provided by the Shapiro-Wilk normality test. The experimental results show that our approach achieves 0.0\% false negative rate and 1.1\% false positive rate. When our tool is employed to reverse engineer real-world ransomware samples, it succeeds in analyzing all the ransomware samples selected from ten representative families.
title Detecting Avalanche Effect in Adversarial Settings: Spotting the Encryption Loops in Ransomware
topic Cryptography and Security
url https://arxiv.org/abs/2604.24131