Wireless Dataset Similarity: Measuring Distances in Supervised and Unsupervised Machine Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Morais, João, Alikhani, Sadjad, Malhotra, Akshay, Hamidi-Rad, Shahab, Alkhateeb, Ahmed
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918270803640320
author Morais, João
Alikhani, Sadjad
Malhotra, Akshay
Hamidi-Rad, Shahab
Alkhateeb, Ahmed
author_facet Morais, João
Alikhani, Sadjad
Malhotra, Akshay
Hamidi-Rad, Shahab
Alkhateeb, Ahmed
contents This paper introduces a task- and model-aware framework for measuring similarity between wireless datasets, enabling applications such as dataset selection/augmentation, simulation-to-real (sim2real) comparison, task-specific synthetic data generation, and informing decisions on model training/adaptation to new deployments. We evaluate candidate dataset distance metrics by how well they predict cross-dataset transferability: if two datasets have a small distance, a model trained on one should perform well on the other. We apply the framework on an unsupervised task, channel state information (CSI) compression, using autoencoders. Using metrics based on UMAP embeddings, combined with Wasserstein and Euclidean distances, we achieve Pearson correlations exceeding 0.85 between dataset distances and train-on-one/test-on-another task performance. We also apply the framework to a supervised beam prediction in the downlink using convolutional neural networks. For this task, we derive a label-aware distance by integrating supervised UMAP and penalties for dataset imbalance. Across both tasks, the resulting distances outperform traditional baselines and consistently exhibit stronger correlations with model transferability, supporting task-relevant comparisons between wireless datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2601_01023
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Wireless Dataset Similarity: Measuring Distances in Supervised and Unsupervised Machine Learning
Morais, João
Alikhani, Sadjad
Malhotra, Akshay
Hamidi-Rad, Shahab
Alkhateeb, Ahmed
Machine Learning
Signal Processing
This paper introduces a task- and model-aware framework for measuring similarity between wireless datasets, enabling applications such as dataset selection/augmentation, simulation-to-real (sim2real) comparison, task-specific synthetic data generation, and informing decisions on model training/adaptation to new deployments. We evaluate candidate dataset distance metrics by how well they predict cross-dataset transferability: if two datasets have a small distance, a model trained on one should perform well on the other. We apply the framework on an unsupervised task, channel state information (CSI) compression, using autoencoders. Using metrics based on UMAP embeddings, combined with Wasserstein and Euclidean distances, we achieve Pearson correlations exceeding 0.85 between dataset distances and train-on-one/test-on-another task performance. We also apply the framework to a supervised beam prediction in the downlink using convolutional neural networks. For this task, we derive a label-aware distance by integrating supervised UMAP and penalties for dataset imbalance. Across both tasks, the resulting distances outperform traditional baselines and consistently exhibit stronger correlations with model transferability, supporting task-relevant comparisons between wireless datasets.
title Wireless Dataset Similarity: Measuring Distances in Supervised and Unsupervised Machine Learning
topic Machine Learning
Signal Processing
url https://arxiv.org/abs/2601.01023