Saved in:
Bibliographic Details
Main Authors: Xiong, Guangwei, Wang, Linyuan, Zheng, Zhizhong, Hou, Senbao, Yan, Bin
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.05791
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910042959118336
author Xiong, Guangwei
Wang, Linyuan
Zheng, Zhizhong
Hou, Senbao
Yan, Bin
author_facet Xiong, Guangwei
Wang, Linyuan
Zheng, Zhizhong
Hou, Senbao
Yan, Bin
contents In 2019, Gohr pioneered the application of deep neural networks to differential cryptanalysis, developing DNN-based neural distinguisher classifiers to analyze the SPECK lightweight block cipher. Unlike traditional differential analysis, which relies on Boolean operations on 0-1 sequences, neural distinguishers extract continuous features, introducing 32-bit multiplications operations that increase complexity and potential redundancy. This study proposes a lightweight neural distinguisher based on quantization-aware training. Leveraging learnable step-size quantization, the model's weights are quantized to 1.58 bits, enabling the replacement of all convolutional multiplication operations with Boolean logic. Additionally, the ReLU activation function is reimplemented as a comparison-based indicator function. This transforms the original 32-bit multiplication-dependent architecture into a lightweight structure composed solely of Boolean operations, additions, and indicator functions. Experimental results confirm significant computational complexity reduction. Owing to a high proportion of zero-valued weights, the total operations amount to just 13.9% of Gohr's model. Critically, the most costly 32-bit multiplications are eliminated, with classification accuracy dropping by only 2.87%. When applied exclusively to the initial convolutional layer, the 128 1-by-1 convolutions are replaced with 4 Boolean operations on 16-bit sequences, incurring a negligible 0.3% accuracy loss.
format Preprint
id arxiv_https___arxiv_org_abs_2603_05791
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Quantization-Aware Training Based Lightweight Method for Neural Distinguishers
Xiong, Guangwei
Wang, Linyuan
Zheng, Zhizhong
Hou, Senbao
Yan, Bin
Cryptography and Security
In 2019, Gohr pioneered the application of deep neural networks to differential cryptanalysis, developing DNN-based neural distinguisher classifiers to analyze the SPECK lightweight block cipher. Unlike traditional differential analysis, which relies on Boolean operations on 0-1 sequences, neural distinguishers extract continuous features, introducing 32-bit multiplications operations that increase complexity and potential redundancy. This study proposes a lightweight neural distinguisher based on quantization-aware training. Leveraging learnable step-size quantization, the model's weights are quantized to 1.58 bits, enabling the replacement of all convolutional multiplication operations with Boolean logic. Additionally, the ReLU activation function is reimplemented as a comparison-based indicator function. This transforms the original 32-bit multiplication-dependent architecture into a lightweight structure composed solely of Boolean operations, additions, and indicator functions. Experimental results confirm significant computational complexity reduction. Owing to a high proportion of zero-valued weights, the total operations amount to just 13.9% of Gohr's model. Critically, the most costly 32-bit multiplications are eliminated, with classification accuracy dropping by only 2.87%. When applied exclusively to the initial convolutional layer, the 128 1-by-1 convolutions are replaced with 4 Boolean operations on 16-bit sequences, incurring a negligible 0.3% accuracy loss.
title A Quantization-Aware Training Based Lightweight Method for Neural Distinguishers
topic Cryptography and Security
url https://arxiv.org/abs/2603.05791