Conformal Correction for Efficiency May be at Odds with Entropy
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914177559298048 |
|---|---|
| author | Xu, Senrong Wang, Tianyu Li, Zenan Yao, Yuan Chen, Taolue Xu, Feng Ma, Xiaoxing |
| author_facet | Xu, Senrong Wang, Tianyu Li, Zenan Yao, Yuan Chen, Taolue Xu, Feng Ma, Xiaoxing |
| contents | Conformal prediction (CP) provides a comprehensive framework to produce statistically rigorous uncertainty sets for black-box machine learning models. To further improve the efficiency of CP, conformal correction is proposed to fine-tune or wrap the base model with an extra module using a conformal-aware inefficiency loss. In this work, we empirically and theoretically identify a trade-off between the CP efficiency and the entropy of model prediction. We then propose an entropy-constrained conformal correction method, exploring a better Pareto optimum between efficiency and entropy. Extensive experimental results on both computer vision and graph datasets demonstrate the efficacy of the proposed method. For instance, it can significantly improve the efficiency of state-of-the-art CP methods by up to 34.4%, given an entropy threshold. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_02704 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Conformal Correction for Efficiency May be at Odds with Entropy Xu, Senrong Wang, Tianyu Li, Zenan Yao, Yuan Chen, Taolue Xu, Feng Ma, Xiaoxing Machine Learning Conformal prediction (CP) provides a comprehensive framework to produce statistically rigorous uncertainty sets for black-box machine learning models. To further improve the efficiency of CP, conformal correction is proposed to fine-tune or wrap the base model with an extra module using a conformal-aware inefficiency loss. In this work, we empirically and theoretically identify a trade-off between the CP efficiency and the entropy of model prediction. We then propose an entropy-constrained conformal correction method, exploring a better Pareto optimum between efficiency and entropy. Extensive experimental results on both computer vision and graph datasets demonstrate the efficacy of the proposed method. For instance, it can significantly improve the efficiency of state-of-the-art CP methods by up to 34.4%, given an entropy threshold. |
| title | Conformal Correction for Efficiency May be at Odds with Entropy |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2512.02704 |