SpectrumFM: Redefining Spectrum Cognition via Foundation Modeling

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Chunyu, Zhang, Hao, Wu, Wei, Zhou, Fuhui, Wu, Qihui, Ng, Derrick Wing Kwan, Chae, Chan-Byoung
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908483386867712
author Liu, Chunyu
Zhang, Hao
Wu, Wei
Zhou, Fuhui
Wu, Qihui
Ng, Derrick Wing Kwan
Chae, Chan-Byoung
author_facet Liu, Chunyu
Zhang, Hao
Wu, Wei
Zhou, Fuhui
Wu, Qihui
Ng, Derrick Wing Kwan
Chae, Chan-Byoung
contents The enhancement of spectrum efficiency and the realization of secure spectrum utilization are critically dependent on spectrum cognition. However, existing spectrum cognition methods often exhibit limited generalization and suboptimal accuracy when deployed across diverse spectrum environments and tasks. To overcome these challenges, we propose a spectrum foundation model, termed SpectrumFM, which provides a new paradigm for spectrum cognition. An innovative spectrum encoder that exploits the convolutional neural networks and the multi-head self attention mechanisms is proposed to effectively capture both fine-grained local signal structures and high-level global dependencies in the spectrum data. To enhance its adaptability, two novel self-supervised learning tasks, namely masked reconstruction and next-slot signal prediction, are developed for pre-training SpectrumFM, enabling the model to learn rich and transferable representations. Furthermore, low-rank adaptation (LoRA) parameter-efficient fine-tuning is exploited to enable SpectrumFM to seamlessly adapt to various downstream spectrum cognition tasks, including spectrum sensing (SS), anomaly detection (AD), and wireless technology classification (WTC). Extensive experiments demonstrate the superiority of SpectrumFM over state-of-the-art methods. Specifically, it improves detection probability in the SS task by 30% at -4 dB signal-to-noise ratio (SNR), boosts the area under the curve (AUC) in the AD task by over 10%, and enhances WTC accuracy by 9.6%.
format Preprint
id arxiv_https___arxiv_org_abs_2508_02742
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SpectrumFM: Redefining Spectrum Cognition via Foundation Modeling
Liu, Chunyu
Zhang, Hao
Wu, Wei
Zhou, Fuhui
Wu, Qihui
Ng, Derrick Wing Kwan
Chae, Chan-Byoung
Signal Processing
Artificial Intelligence
Machine Learning
The enhancement of spectrum efficiency and the realization of secure spectrum utilization are critically dependent on spectrum cognition. However, existing spectrum cognition methods often exhibit limited generalization and suboptimal accuracy when deployed across diverse spectrum environments and tasks. To overcome these challenges, we propose a spectrum foundation model, termed SpectrumFM, which provides a new paradigm for spectrum cognition. An innovative spectrum encoder that exploits the convolutional neural networks and the multi-head self attention mechanisms is proposed to effectively capture both fine-grained local signal structures and high-level global dependencies in the spectrum data. To enhance its adaptability, two novel self-supervised learning tasks, namely masked reconstruction and next-slot signal prediction, are developed for pre-training SpectrumFM, enabling the model to learn rich and transferable representations. Furthermore, low-rank adaptation (LoRA) parameter-efficient fine-tuning is exploited to enable SpectrumFM to seamlessly adapt to various downstream spectrum cognition tasks, including spectrum sensing (SS), anomaly detection (AD), and wireless technology classification (WTC). Extensive experiments demonstrate the superiority of SpectrumFM over state-of-the-art methods. Specifically, it improves detection probability in the SS task by 30% at -4 dB signal-to-noise ratio (SNR), boosts the area under the curve (AUC) in the AD task by over 10%, and enhances WTC accuracy by 9.6%.
title SpectrumFM: Redefining Spectrum Cognition via Foundation Modeling
topic Signal Processing
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2508.02742