DAGnosis: Localized Identification of Data Inconsistencies using Structures
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866907814672203776 |
|---|---|
| author | Huynh, Nicolas Berrevoets, Jeroen Seedat, Nabeel Crabbé, Jonathan Qian, Zhaozhi van der Schaar, Mihaela |
| author_facet | Huynh, Nicolas Berrevoets, Jeroen Seedat, Nabeel Crabbé, Jonathan Qian, Zhaozhi van der Schaar, Mihaela |
| contents | Identification and appropriate handling of inconsistencies in data at deployment time is crucial to reliably use machine learning models. While recent data-centric methods are able to identify such inconsistencies with respect to the training set, they suffer from two key limitations: (1) suboptimality in settings where features exhibit statistical independencies, due to their usage of compressive representations and (2) lack of localization to pin-point why a sample might be flagged as inconsistent, which is important to guide future data collection. We solve these two fundamental limitations using directed acyclic graphs (DAGs) to encode the training set's features probability distribution and independencies as a structure. Our method, called DAGnosis, leverages these structural interactions to bring valuable and insightful data-centric conclusions. DAGnosis unlocks the localization of the causes of inconsistencies on a DAG, an aspect overlooked by previous approaches. Moreover, we show empirically that leveraging these interactions (1) leads to more accurate conclusions in detecting inconsistencies, as well as (2) provides more detailed insights into why some samples are flagged. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_17599 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DAGnosis: Localized Identification of Data Inconsistencies using Structures Huynh, Nicolas Berrevoets, Jeroen Seedat, Nabeel Crabbé, Jonathan Qian, Zhaozhi van der Schaar, Mihaela Machine Learning Artificial Intelligence Identification and appropriate handling of inconsistencies in data at deployment time is crucial to reliably use machine learning models. While recent data-centric methods are able to identify such inconsistencies with respect to the training set, they suffer from two key limitations: (1) suboptimality in settings where features exhibit statistical independencies, due to their usage of compressive representations and (2) lack of localization to pin-point why a sample might be flagged as inconsistent, which is important to guide future data collection. We solve these two fundamental limitations using directed acyclic graphs (DAGs) to encode the training set's features probability distribution and independencies as a structure. Our method, called DAGnosis, leverages these structural interactions to bring valuable and insightful data-centric conclusions. DAGnosis unlocks the localization of the causes of inconsistencies on a DAG, an aspect overlooked by previous approaches. Moreover, we show empirically that leveraging these interactions (1) leads to more accurate conclusions in detecting inconsistencies, as well as (2) provides more detailed insights into why some samples are flagged. |
| title | DAGnosis: Localized Identification of Data Inconsistencies using Structures |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2402.17599 |