A Dataset Similarity Evaluation Framework for Wireless Communications and Sensing
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916512862830592 |
|---|---|
| author | Morais, Joao Alikhani, Sadjad Malhotra, Akshay Hamidi-Rad, Shahab Alkhateeb, Ahmed |
| author_facet | Morais, Joao Alikhani, Sadjad Malhotra, Akshay Hamidi-Rad, Shahab Alkhateeb, Ahmed |
| contents | This paper introduces a task-specific, model-agnostic framework for evaluating dataset similarity, providing a means to assess and compare dataset realism and quality. Such a framework is crucial for augmenting real-world data, improving benchmarking, and making informed retraining decisions when adapting to new deployment settings, such as different sites or frequency bands. The proposed framework is employed to design metrics based on UMAP topology-preserving dimensionality reduction, leveraging Wasserstein and Euclidean distances on latent space KNN clusters. The designed metrics show correlations above 0.85 between dataset distances and model performances on a channel state information compression unsupervised machine learning task leveraging autoencoder architectures. The results show that the designed metrics outperform traditional methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_05556 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Dataset Similarity Evaluation Framework for Wireless Communications and Sensing Morais, Joao Alikhani, Sadjad Malhotra, Akshay Hamidi-Rad, Shahab Alkhateeb, Ahmed Signal Processing Information Theory This paper introduces a task-specific, model-agnostic framework for evaluating dataset similarity, providing a means to assess and compare dataset realism and quality. Such a framework is crucial for augmenting real-world data, improving benchmarking, and making informed retraining decisions when adapting to new deployment settings, such as different sites or frequency bands. The proposed framework is employed to design metrics based on UMAP topology-preserving dimensionality reduction, leveraging Wasserstein and Euclidean distances on latent space KNN clusters. The designed metrics show correlations above 0.85 between dataset distances and model performances on a channel state information compression unsupervised machine learning task leveraging autoencoder architectures. The results show that the designed metrics outperform traditional methods. |
| title | A Dataset Similarity Evaluation Framework for Wireless Communications and Sensing |
| topic | Signal Processing Information Theory |
| url | https://arxiv.org/abs/2412.05556 |