Divisi: Interactive Search and Visualization for Scalable Exploratory Subgroup Analysis

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Sivaraman, Venkatesh, Li, Zexuan, Perer, Adam
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909494037970944
author Sivaraman, Venkatesh
Li, Zexuan
Perer, Adam
author_facet Sivaraman, Venkatesh
Li, Zexuan
Perer, Adam
contents Analyzing data subgroups is a common data science task to build intuition about a dataset and identify areas to improve model performance. However, subgroup analysis is prohibitively difficult in datasets with many features, and existing tools limit unexpected discoveries by relying on user-defined or static subgroups. We propose exploratory subgroup analysis as a set of tasks in which practitioners discover, evaluate, and curate interesting subgroups to build understanding about datasets and models. To support these tasks we introduce Divisi, an interactive notebook-based tool underpinned by a fast approximate subgroup discovery algorithm. Divisi's interface allows data scientists to interactively re-rank and refine subgroups and to visualize their overlap and coverage in the novel Subgroup Map. Through a think-aloud study with 13 practitioners, we find that Divisi can help uncover surprising patterns in data features and their interactions, and that it encourages more thorough exploration of subtypes in complex data.
format Preprint
id arxiv_https___arxiv_org_abs_2502_10537
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Divisi: Interactive Search and Visualization for Scalable Exploratory Subgroup Analysis
Sivaraman, Venkatesh
Li, Zexuan
Perer, Adam
Human-Computer Interaction
Analyzing data subgroups is a common data science task to build intuition about a dataset and identify areas to improve model performance. However, subgroup analysis is prohibitively difficult in datasets with many features, and existing tools limit unexpected discoveries by relying on user-defined or static subgroups. We propose exploratory subgroup analysis as a set of tasks in which practitioners discover, evaluate, and curate interesting subgroups to build understanding about datasets and models. To support these tasks we introduce Divisi, an interactive notebook-based tool underpinned by a fast approximate subgroup discovery algorithm. Divisi's interface allows data scientists to interactively re-rank and refine subgroups and to visualize their overlap and coverage in the novel Subgroup Map. Through a think-aloud study with 13 practitioners, we find that Divisi can help uncover surprising patterns in data features and their interactions, and that it encourages more thorough exploration of subtypes in complex data.
title Divisi: Interactive Search and Visualization for Scalable Exploratory Subgroup Analysis
topic Human-Computer Interaction
url https://arxiv.org/abs/2502.10537