Uncovering Misattributed Suicide Causes through Annotation Inconsistency Detection in Death Investigation Notes
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866929295954280448 |
|---|---|
| author | Wang, Song Zhou, Yiliang Han, Ziqiang Tao, Cui Xiao, Yunyu Ding, Ying Ghosh, Joydeep Peng, Yifan |
| author_facet | Wang, Song Zhou, Yiliang Han, Ziqiang Tao, Cui Xiao, Yunyu Ding, Ying Ghosh, Joydeep Peng, Yifan |
| contents | Data accuracy is essential for scientific research and policy development. The National Violent Death Reporting System (NVDRS) data is widely used for discovering the patterns and causes of death. Recent studies suggested the annotation inconsistencies within the NVDRS and the potential impact on erroneous suicide-cause attributions. We present an empirical Natural Language Processing (NLP) approach to detect annotation inconsistencies and adopt a cross-validation-like paradigm to identify problematic instances. We analyzed 267,804 suicide death incidents between 2003 and 2020 from the NVDRS. Our results showed that incorporating the target state's data into training the suicide-crisis classifier brought an increase of 5.4% to the F-1 score on the target state's test set and a decrease of 1.1% on other states' test set. To conclude, we demonstrated the annotation inconsistencies in NVDRS's death investigation notes, identified problematic instances, evaluated the effectiveness of correcting problematic instances, and eventually proposed an NLP improvement solution. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_19432 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Uncovering Misattributed Suicide Causes through Annotation Inconsistency Detection in Death Investigation Notes Wang, Song Zhou, Yiliang Han, Ziqiang Tao, Cui Xiao, Yunyu Ding, Ying Ghosh, Joydeep Peng, Yifan Computation and Language Artificial Intelligence Data accuracy is essential for scientific research and policy development. The National Violent Death Reporting System (NVDRS) data is widely used for discovering the patterns and causes of death. Recent studies suggested the annotation inconsistencies within the NVDRS and the potential impact on erroneous suicide-cause attributions. We present an empirical Natural Language Processing (NLP) approach to detect annotation inconsistencies and adopt a cross-validation-like paradigm to identify problematic instances. We analyzed 267,804 suicide death incidents between 2003 and 2020 from the NVDRS. Our results showed that incorporating the target state's data into training the suicide-crisis classifier brought an increase of 5.4% to the F-1 score on the target state's test set and a decrease of 1.1% on other states' test set. To conclude, we demonstrated the annotation inconsistencies in NVDRS's death investigation notes, identified problematic instances, evaluated the effectiveness of correcting problematic instances, and eventually proposed an NLP improvement solution. |
| title | Uncovering Misattributed Suicide Causes through Annotation Inconsistency Detection in Death Investigation Notes |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2403.19432 |