Error Detection and Constraint Recovery in Hierarchical Multi-Label Classification without Prior Knowledge
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914219282137088 |
|---|---|
| author | Kricheli, Joshua Shay Vo, Khoa Datta, Aniruddha Ozgur, Spencer Shakarian, Paulo |
| author_facet | Kricheli, Joshua Shay Vo, Khoa Datta, Aniruddha Ozgur, Spencer Shakarian, Paulo |
| contents | Recent advances in Hierarchical Multi-label Classification (HMC), particularly neurosymbolic-based approaches, have demonstrated improved consistency and accuracy by enforcing constraints on a neural model during training. However, such work assumes the existence of such constraints a-priori. In this paper, we relax this strong assumption and present an approach based on Error Detection Rules (EDR) that allow for learning explainable rules about the failure modes of machine learning models. We show that these rules are not only effective in detecting when a machine learning classifier has made an error but also can be leveraged as constraints for HMC, thereby allowing the recovery of explainable constraints even if they are not provided. We show that our approach is effective in detecting machine learning errors and recovering constraints, is noise tolerant, and can function as a source of knowledge for neurosymbolic models on multiple datasets, including a newly introduced military vehicle recognition dataset. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_15192 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Error Detection and Constraint Recovery in Hierarchical Multi-Label Classification without Prior Knowledge Kricheli, Joshua Shay Vo, Khoa Datta, Aniruddha Ozgur, Spencer Shakarian, Paulo Machine Learning Artificial Intelligence Logic in Computer Science Symbolic Computation 68T05, 68T27, 68T30 I.2.4; I.2.6 Recent advances in Hierarchical Multi-label Classification (HMC), particularly neurosymbolic-based approaches, have demonstrated improved consistency and accuracy by enforcing constraints on a neural model during training. However, such work assumes the existence of such constraints a-priori. In this paper, we relax this strong assumption and present an approach based on Error Detection Rules (EDR) that allow for learning explainable rules about the failure modes of machine learning models. We show that these rules are not only effective in detecting when a machine learning classifier has made an error but also can be leveraged as constraints for HMC, thereby allowing the recovery of explainable constraints even if they are not provided. We show that our approach is effective in detecting machine learning errors and recovering constraints, is noise tolerant, and can function as a source of knowledge for neurosymbolic models on multiple datasets, including a newly introduced military vehicle recognition dataset. |
| title | Error Detection and Constraint Recovery in Hierarchical Multi-Label Classification without Prior Knowledge |
| topic | Machine Learning Artificial Intelligence Logic in Computer Science Symbolic Computation 68T05, 68T27, 68T30 I.2.4; I.2.6 |
| url | https://arxiv.org/abs/2407.15192 |