WiFo: Wireless Foundation Model for Channel Prediction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Boxun, Gao, Shijian, Liu, Xuanyu, Cheng, Xiang, Yang, Liuqing
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908273946394624
author Liu, Boxun
Gao, Shijian
Liu, Xuanyu
Cheng, Xiang
Yang, Liuqing
author_facet Liu, Boxun
Gao, Shijian
Liu, Xuanyu
Cheng, Xiang
Yang, Liuqing
contents Channel prediction permits to acquire channel state information (CSI) without signaling overhead. However, almost all existing channel prediction methods necessitate the deployment of a dedicated model to accommodate a specific configuration. Leveraging the powerful modeling and multi-task learning capabilities of foundation models, we propose the first space-time-frequency (STF) wireless foundation model (WiFo) to address time-frequency channel prediction tasks in a one-for-all manner. Specifically, WiFo is initially pre-trained over massive and extensive diverse CSI datasets. Then, the model will be instantly used for channel prediction under various CSI configurations without any fine-tuning. We propose a masked autoencoder (MAE)-based network structure for WiFo to handle heterogeneous STF CSI data, and design several mask reconstruction tasks for self-supervised pre-training to capture the inherent 3D variations of CSI. To fully unleash its predictive power, we build a large-scale heterogeneous simulated CSI dataset consisting of 160K CSI samples for pre-training. Simulations validate its superior unified learning performance across multiple datasets and demonstrate its state-of-the-art (SOTA) zero-shot generalization performance via comparisons with other full-shot baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2412_08908
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle WiFo: Wireless Foundation Model for Channel Prediction
Liu, Boxun
Gao, Shijian
Liu, Xuanyu
Cheng, Xiang
Yang, Liuqing
Signal Processing
Channel prediction permits to acquire channel state information (CSI) without signaling overhead. However, almost all existing channel prediction methods necessitate the deployment of a dedicated model to accommodate a specific configuration. Leveraging the powerful modeling and multi-task learning capabilities of foundation models, we propose the first space-time-frequency (STF) wireless foundation model (WiFo) to address time-frequency channel prediction tasks in a one-for-all manner. Specifically, WiFo is initially pre-trained over massive and extensive diverse CSI datasets. Then, the model will be instantly used for channel prediction under various CSI configurations without any fine-tuning. We propose a masked autoencoder (MAE)-based network structure for WiFo to handle heterogeneous STF CSI data, and design several mask reconstruction tasks for self-supervised pre-training to capture the inherent 3D variations of CSI. To fully unleash its predictive power, we build a large-scale heterogeneous simulated CSI dataset consisting of 160K CSI samples for pre-training. Simulations validate its superior unified learning performance across multiple datasets and demonstrate its state-of-the-art (SOTA) zero-shot generalization performance via comparisons with other full-shot baselines.
title WiFo: Wireless Foundation Model for Channel Prediction
topic Signal Processing
url https://arxiv.org/abs/2412.08908