Calibrating AI Models for Few-Shot Demodulation via Conformal Prediction
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914777982304256 |
|---|---|
| author | Cohen, Kfir M. Park, Sangwoo Simeone, Osvaldo Shamai, Shlomo |
| author_facet | Cohen, Kfir M. Park, Sangwoo Simeone, Osvaldo Shamai, Shlomo |
| contents | AI tools can be useful to address model deficits in the design of communication systems. However, conventional learning-based AI algorithms yield poorly calibrated decisions, unabling to quantify their outputs uncertainty. While Bayesian learning can enhance calibration by capturing epistemic uncertainty caused by limited data availability, formal calibration guarantees only hold under strong assumptions about the ground-truth, unknown, data generation mechanism. We propose to leverage the conformal prediction framework to obtain data-driven set predictions whose calibration properties hold irrespective of the data distribution. Specifically, we investigate the design of baseband demodulators in the presence of hard-to-model nonlinearities such as hardware imperfections, and propose set-based demodulators based on conformal prediction. Numerical results confirm the theoretical validity of the proposed demodulators, and bring insights into their average prediction set size efficiency. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2210_04621 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | Calibrating AI Models for Few-Shot Demodulation via Conformal Prediction Cohen, Kfir M. Park, Sangwoo Simeone, Osvaldo Shamai, Shlomo Signal Processing Information Theory AI tools can be useful to address model deficits in the design of communication systems. However, conventional learning-based AI algorithms yield poorly calibrated decisions, unabling to quantify their outputs uncertainty. While Bayesian learning can enhance calibration by capturing epistemic uncertainty caused by limited data availability, formal calibration guarantees only hold under strong assumptions about the ground-truth, unknown, data generation mechanism. We propose to leverage the conformal prediction framework to obtain data-driven set predictions whose calibration properties hold irrespective of the data distribution. Specifically, we investigate the design of baseband demodulators in the presence of hard-to-model nonlinearities such as hardware imperfections, and propose set-based demodulators based on conformal prediction. Numerical results confirm the theoretical validity of the proposed demodulators, and bring insights into their average prediction set size efficiency. |
| title | Calibrating AI Models for Few-Shot Demodulation via Conformal Prediction |
| topic | Signal Processing Information Theory |
| url | https://arxiv.org/abs/2210.04621 |