Spatial-Aware Conformal Prediction for Trustworthy Hyperspectral Image Classification

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Liu, Kangdao, Sun, Tianhao, Zeng, Hao, Zhang, Yongshan, Pun, Chi-Man, Vong, Chi-Man
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912092673540096
author Liu, Kangdao
Sun, Tianhao
Zeng, Hao
Zhang, Yongshan
Pun, Chi-Man
Vong, Chi-Man
author_facet Liu, Kangdao
Sun, Tianhao
Zeng, Hao
Zhang, Yongshan
Pun, Chi-Man
Vong, Chi-Man
contents Hyperspectral image (HSI) classification involves assigning unique labels to each pixel to identify various land cover categories. While deep classifiers have achieved high predictive accuracy in this field, they lack the ability to rigorously quantify confidence in their predictions. Quantifying the certainty of model predictions is crucial for the safe usage of predictive models, and this limitation restricts their application in critical contexts where the cost of prediction errors is significant. To support the safe deployment of HSI classifiers, we first provide a theoretical proof establishing the validity of the emerging uncertainty quantification technique, conformal prediction, in the context of HSI classification. We then propose a conformal procedure that equips any trained HSI classifier with trustworthy prediction sets, ensuring that these sets include the true labels with a user-specified probability (e.g., 95\%). Building on this foundation, we introduce Spatial-Aware Conformal Prediction (\texttt{SACP}), a conformal prediction framework specifically designed for HSI data. This method integrates essential spatial information inherent in HSIs by aggregating the non-conformity scores of pixels with high spatial correlation, which effectively enhances the efficiency of prediction sets. Both theoretical and empirical results validate the effectiveness of our proposed approach. The source code is available at \url{https://github.com/J4ckLiu/SACP}.
format Preprint
id arxiv_https___arxiv_org_abs_2409_01236
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Spatial-Aware Conformal Prediction for Trustworthy Hyperspectral Image Classification
Liu, Kangdao
Sun, Tianhao
Zeng, Hao
Zhang, Yongshan
Pun, Chi-Man
Vong, Chi-Man
Computer Vision and Pattern Recognition
Hyperspectral image (HSI) classification involves assigning unique labels to each pixel to identify various land cover categories. While deep classifiers have achieved high predictive accuracy in this field, they lack the ability to rigorously quantify confidence in their predictions. Quantifying the certainty of model predictions is crucial for the safe usage of predictive models, and this limitation restricts their application in critical contexts where the cost of prediction errors is significant. To support the safe deployment of HSI classifiers, we first provide a theoretical proof establishing the validity of the emerging uncertainty quantification technique, conformal prediction, in the context of HSI classification. We then propose a conformal procedure that equips any trained HSI classifier with trustworthy prediction sets, ensuring that these sets include the true labels with a user-specified probability (e.g., 95\%). Building on this foundation, we introduce Spatial-Aware Conformal Prediction (\texttt{SACP}), a conformal prediction framework specifically designed for HSI data. This method integrates essential spatial information inherent in HSIs by aggregating the non-conformity scores of pixels with high spatial correlation, which effectively enhances the efficiency of prediction sets. Both theoretical and empirical results validate the effectiveness of our proposed approach. The source code is available at \url{https://github.com/J4ckLiu/SACP}.
title Spatial-Aware Conformal Prediction for Trustworthy Hyperspectral Image Classification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.01236