d-DQIVAR: Data-centric Visual Analytics and Reasoning for Data Quality Improvement
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915392181501952 |
|---|---|
| author | Hong, Hyein Yoo, Sangbong Choi, SeokHwan Kim, Jisue Seo, Seongbum Cho, Haneol Kim, Chansoo Jang, Yun |
| author_facet | Hong, Hyein Yoo, Sangbong Choi, SeokHwan Kim, Jisue Seo, Seongbum Cho, Haneol Kim, Chansoo Jang, Yun |
| contents | Approaches to enhancing data quality (DQ) are classified into two main categories: data- and process-driven. However, prior research has predominantly utilized batch data preprocessing within the data-driven framework, which often proves insufficient for optimizing machine learning (ML) model performance and frequently leads to distortions in data characteristics. Existing studies have primarily focused on data preprocessing rather than genuine data quality improvement (DQI). In this paper, we introduce d-DQIVAR, a novel visual analytics system designed to facilitate DQI strategies aimed at improving ML model performance. Our system integrates visual analytics techniques that leverage both data-driven and process-driven approaches. Data-driven techniques tackle DQ issues such as imputation, outlier detection, deletion, format standardization, removal of duplicate records, and feature selection. Process-driven strategies encompass evaluating DQ and DQI procedures by considering DQ dimensions and ML model performance and applying the Kolmogorov-Smirnov test. We illustrate how our system empowers users to harness expert and domain knowledge effectively within a practical workflow through case studies, evaluations, and user studies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_11960 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | d-DQIVAR: Data-centric Visual Analytics and Reasoning for Data Quality Improvement Hong, Hyein Yoo, Sangbong Choi, SeokHwan Kim, Jisue Seo, Seongbum Cho, Haneol Kim, Chansoo Jang, Yun Human-Computer Interaction Machine Learning Approaches to enhancing data quality (DQ) are classified into two main categories: data- and process-driven. However, prior research has predominantly utilized batch data preprocessing within the data-driven framework, which often proves insufficient for optimizing machine learning (ML) model performance and frequently leads to distortions in data characteristics. Existing studies have primarily focused on data preprocessing rather than genuine data quality improvement (DQI). In this paper, we introduce d-DQIVAR, a novel visual analytics system designed to facilitate DQI strategies aimed at improving ML model performance. Our system integrates visual analytics techniques that leverage both data-driven and process-driven approaches. Data-driven techniques tackle DQ issues such as imputation, outlier detection, deletion, format standardization, removal of duplicate records, and feature selection. Process-driven strategies encompass evaluating DQ and DQI procedures by considering DQ dimensions and ML model performance and applying the Kolmogorov-Smirnov test. We illustrate how our system empowers users to harness expert and domain knowledge effectively within a practical workflow through case studies, evaluations, and user studies. |
| title | d-DQIVAR: Data-centric Visual Analytics and Reasoning for Data Quality Improvement |
| topic | Human-Computer Interaction Machine Learning |
| url | https://arxiv.org/abs/2507.11960 |