Exact characterization of ε-Safe Decision Regions for exponential family distributions and Multi Cost SVM approximation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910804698202112 |
|---|---|
| author | Carlevaro, Alberto Alamo, Teodoro Dabbene, Fabrizio Mongelli, Maurizio |
| author_facet | Carlevaro, Alberto Alamo, Teodoro Dabbene, Fabrizio Mongelli, Maurizio |
| contents | Probabilistic guarantees on the prediction of data-driven classifiers are necessary to define models that can be considered reliable. This is a key requirement for modern machine learning in which the goodness of a system is measured in terms of trustworthiness, clearly dividing what is safe from what is unsafe. The spirit of this paper is exactly in this direction. First, we introduce a formal definition of ε-Safe Decision Region, a subset of the input space in which the prediction of a target (safe) class is probabilistically guaranteed. Second, we prove that, when data come from exponential family distributions, the form of such a region is analytically determined and controllable by design parameters, i.e. the probability of sampling the target class and the confidence on the prediction. However, the request of having exponential data is not always possible. Inspired by this limitation, we developed Multi Cost SVM, an SVM based algorithm that approximates the safe region and is also able to handle unbalanced data. The research is complemented by experiments and code available for reproducibility. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_17731 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Exact characterization of ε-Safe Decision Regions for exponential family distributions and Multi Cost SVM approximation Carlevaro, Alberto Alamo, Teodoro Dabbene, Fabrizio Mongelli, Maurizio Machine Learning Artificial Intelligence Probabilistic guarantees on the prediction of data-driven classifiers are necessary to define models that can be considered reliable. This is a key requirement for modern machine learning in which the goodness of a system is measured in terms of trustworthiness, clearly dividing what is safe from what is unsafe. The spirit of this paper is exactly in this direction. First, we introduce a formal definition of ε-Safe Decision Region, a subset of the input space in which the prediction of a target (safe) class is probabilistically guaranteed. Second, we prove that, when data come from exponential family distributions, the form of such a region is analytically determined and controllable by design parameters, i.e. the probability of sampling the target class and the confidence on the prediction. However, the request of having exponential data is not always possible. Inspired by this limitation, we developed Multi Cost SVM, an SVM based algorithm that approximates the safe region and is also able to handle unbalanced data. The research is complemented by experiments and code available for reproducibility. |
| title | Exact characterization of ε-Safe Decision Regions for exponential family distributions and Multi Cost SVM approximation |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2501.17731 |