Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.11230 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916251407745024 |
|---|---|
| author | Koseoglu, Baran Traverso, Luca Topiwalla, Mohammed Kraev, Egor Szopory, Zoltan |
| author_facet | Koseoglu, Baran Traverso, Luca Topiwalla, Mohammed Kraev, Egor Szopory, Zoltan |
| contents | Output thresholding is the technique to search for the best threshold to be used during inference for any classifiers that can produce probability estimates on train and testing datasets. It is particularly useful in high imbalance classification problems where the default threshold is not able to refer to imbalance in class distributions and fail to give the best performance. This paper proposes OTLP, a thresholding framework using mixed integer linear programming which is model agnostic, can support different objective functions and different set of constraints for a diverse set of problems including both balanced and imbalanced classification problems. It is particularly useful in real world applications where the theoretical thresholding techniques are not able to address to product related requirements and complexity of the applications which utilize machine learning models. Through the use of Credit Card Fraud Detection Dataset, we evaluate the usefulness of the framework. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_11230 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | OTLP: Output Thresholding Using Mixed Integer Linear Programming Koseoglu, Baran Traverso, Luca Topiwalla, Mohammed Kraev, Egor Szopory, Zoltan Machine Learning Output thresholding is the technique to search for the best threshold to be used during inference for any classifiers that can produce probability estimates on train and testing datasets. It is particularly useful in high imbalance classification problems where the default threshold is not able to refer to imbalance in class distributions and fail to give the best performance. This paper proposes OTLP, a thresholding framework using mixed integer linear programming which is model agnostic, can support different objective functions and different set of constraints for a diverse set of problems including both balanced and imbalanced classification problems. It is particularly useful in real world applications where the theoretical thresholding techniques are not able to address to product related requirements and complexity of the applications which utilize machine learning models. Through the use of Credit Card Fraud Detection Dataset, we evaluate the usefulness of the framework. |
| title | OTLP: Output Thresholding Using Mixed Integer Linear Programming |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2405.11230 |