DenoMAE: A Multimodal Autoencoder for Denoising Modulation Signals

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Faysal, Atik, Boushine, Taha, Rostami, Mohammad, Roshan, Reihaneh Gh., Wang, Huaxia, Muralidhar, Nikhil, Sahoo, Avimanyu, Yao, Yu-Dong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910792026161152
author Faysal, Atik
Boushine, Taha
Rostami, Mohammad
Roshan, Reihaneh Gh.
Wang, Huaxia
Muralidhar, Nikhil
Sahoo, Avimanyu
Yao, Yu-Dong
author_facet Faysal, Atik
Boushine, Taha
Rostami, Mohammad
Roshan, Reihaneh Gh.
Wang, Huaxia
Muralidhar, Nikhil
Sahoo, Avimanyu
Yao, Yu-Dong
contents We propose Denoising Masked Autoencoder (Deno-MAE), a novel multimodal autoencoder framework for denoising modulation signals during pretraining. DenoMAE extends the concept of masked autoencoders by incorporating multiple input modalities, including noise as an explicit modality, to enhance cross-modal learning and improve denoising performance. The network is pre-trained using unlabeled noisy modulation signals and constellation diagrams, effectively learning to reconstruct their equivalent noiseless signals and diagrams. Deno-MAE achieves state-of-the-art accuracy in automatic modulation classification tasks with significantly fewer training samples, demonstrating a 10% reduction in unlabeled pretraining data and a 3% reduction in labeled fine-tuning data compared to existing approaches. Moreover, our model exhibits robust performance across varying signal-to-noise ratios (SNRs) and supports extrapolation on unseen lower SNRs. The results indicate that DenoMAE is an efficient, flexible, and data-efficient solution for denoising and classifying modulation signals in challenging noise-intensive environments.
format Preprint
id arxiv_https___arxiv_org_abs_2501_11538
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DenoMAE: A Multimodal Autoencoder for Denoising Modulation Signals
Faysal, Atik
Boushine, Taha
Rostami, Mohammad
Roshan, Reihaneh Gh.
Wang, Huaxia
Muralidhar, Nikhil
Sahoo, Avimanyu
Yao, Yu-Dong
Machine Learning
We propose Denoising Masked Autoencoder (Deno-MAE), a novel multimodal autoencoder framework for denoising modulation signals during pretraining. DenoMAE extends the concept of masked autoencoders by incorporating multiple input modalities, including noise as an explicit modality, to enhance cross-modal learning and improve denoising performance. The network is pre-trained using unlabeled noisy modulation signals and constellation diagrams, effectively learning to reconstruct their equivalent noiseless signals and diagrams. Deno-MAE achieves state-of-the-art accuracy in automatic modulation classification tasks with significantly fewer training samples, demonstrating a 10% reduction in unlabeled pretraining data and a 3% reduction in labeled fine-tuning data compared to existing approaches. Moreover, our model exhibits robust performance across varying signal-to-noise ratios (SNRs) and supports extrapolation on unseen lower SNRs. The results indicate that DenoMAE is an efficient, flexible, and data-efficient solution for denoising and classifying modulation signals in challenging noise-intensive environments.
title DenoMAE: A Multimodal Autoencoder for Denoising Modulation Signals
topic Machine Learning
url https://arxiv.org/abs/2501.11538