Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2305.12039 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911810027782144 |
|---|---|
| author | Zhang, Qin An, Dongsheng Xiao, Tianjun He, Tong Tang, Qingming Wu, Ying Nian Tighe, Joseph Xing, Yifan Soatto, Stefano |
| author_facet | Zhang, Qin An, Dongsheng Xiao, Tianjun He, Tong Tang, Qingming Wu, Ying Nian Tighe, Joseph Xing, Yifan Soatto, Stefano |
| contents | In deep metric learning for visual recognition, the calibration of distance thresholds is crucial for achieving desired model performance in the true positive rates (TPR) or true negative rates (TNR). However, calibrating this threshold presents challenges in open-world scenarios, where the test classes can be entirely disjoint from those encountered during training. We define the problem of finding distance thresholds for a trained embedding model to achieve target performance metrics over unseen open-world test classes as open-world threshold calibration. Existing posthoc threshold calibration methods, reliant on inductive inference and requiring a calibration dataset with a similar distance distribution as the test data, often prove ineffective in open-world scenarios. To address this, we introduce OpenGCN, a Graph Neural Network-based transductive threshold calibration method with enhanced adaptability and robustness. OpenGCN learns to predict pairwise connectivity for the unlabeled test instances embedded in a graph to determine its TPR and TNR at various distance thresholds, allowing for transductive inference of the distance thresholds which also incorporates test-time information. Extensive experiments across open-world visual recognition benchmarks validate OpenGCN's superiority over existing posthoc calibration methods for open-world threshold calibration. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_12039 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Learning for Transductive Threshold Calibration in Open-World Recognition Zhang, Qin An, Dongsheng Xiao, Tianjun He, Tong Tang, Qingming Wu, Ying Nian Tighe, Joseph Xing, Yifan Soatto, Stefano Computer Vision and Pattern Recognition In deep metric learning for visual recognition, the calibration of distance thresholds is crucial for achieving desired model performance in the true positive rates (TPR) or true negative rates (TNR). However, calibrating this threshold presents challenges in open-world scenarios, where the test classes can be entirely disjoint from those encountered during training. We define the problem of finding distance thresholds for a trained embedding model to achieve target performance metrics over unseen open-world test classes as open-world threshold calibration. Existing posthoc threshold calibration methods, reliant on inductive inference and requiring a calibration dataset with a similar distance distribution as the test data, often prove ineffective in open-world scenarios. To address this, we introduce OpenGCN, a Graph Neural Network-based transductive threshold calibration method with enhanced adaptability and robustness. OpenGCN learns to predict pairwise connectivity for the unlabeled test instances embedded in a graph to determine its TPR and TNR at various distance thresholds, allowing for transductive inference of the distance thresholds which also incorporates test-time information. Extensive experiments across open-world visual recognition benchmarks validate OpenGCN's superiority over existing posthoc calibration methods for open-world threshold calibration. |
| title | Learning for Transductive Threshold Calibration in Open-World Recognition |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2305.12039 |