Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2502.18221 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910844046016512 |
|---|---|
| author | Kassaie, Besat Tompa, Frank Wm. |
| author_facet | Kassaie, Besat Tompa, Frank Wm. |
| contents | Improving data quality in unstructured documents is a long-standing challenge. Unstructured data, especially in textual form, inherently lacks defined semantics, which poses significant challenges for effective processing and for ensuring data quality. We propose leveraging information extraction algorithms to design, apply, and explain data cleaning processes for documents. Specifically, for a simple document update model, we identify and verify a set of sufficient conditions for rule-based extraction programs to qualify for inclusion in our document cleaning framework. Through experiments conducted on medical records, we demonstrate that our approach provides an effective framework for identifying and correcting data quality problems, thereby highlighting its practical value in real-world applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_18221 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Improving Unstructured Data Quality via Updatable Extracted Views Kassaie, Besat Tompa, Frank Wm. Databases Formal Languages and Automata Theory H.2; I.7 Improving data quality in unstructured documents is a long-standing challenge. Unstructured data, especially in textual form, inherently lacks defined semantics, which poses significant challenges for effective processing and for ensuring data quality. We propose leveraging information extraction algorithms to design, apply, and explain data cleaning processes for documents. Specifically, for a simple document update model, we identify and verify a set of sufficient conditions for rule-based extraction programs to qualify for inclusion in our document cleaning framework. Through experiments conducted on medical records, we demonstrate that our approach provides an effective framework for identifying and correcting data quality problems, thereby highlighting its practical value in real-world applications. |
| title | Improving Unstructured Data Quality via Updatable Extracted Views |
| topic | Databases Formal Languages and Automata Theory H.2; I.7 |
| url | https://arxiv.org/abs/2502.18221 |