Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ahmad, Ghazi Shazan, Agarwal, Shubham, Mitra, Subrata, Rossi, Ryan, Doshi, Manav, Porwal, Vibhor, Paila, Syam Manoj Kumar
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:https://arxiv.org/abs/2411.18657
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912136065712128
author Ahmad, Ghazi Shazan
Agarwal, Shubham
Mitra, Subrata
Rossi, Ryan
Doshi, Manav
Porwal, Vibhor
Paila, Syam Manoj Kumar
author_facet Ahmad, Ghazi Shazan
Agarwal, Shubham
Mitra, Subrata
Rossi, Ryan
Doshi, Manav
Porwal, Vibhor
Paila, Syam Manoj Kumar
contents Automated visualization recommendations (vis-rec) help users to derive crucial insights from new datasets. Typically, such automated vis-rec models first calculate a large number of statistics from the datasets and then use machine-learning models to score or classify multiple visualizations choices to recommend the most effective ones, as per the statistics. However, state-of-the art models rely on very large number of expensive statistics and therefore using such models on large datasets become infeasible due to prohibitively large computational time, limiting the effectiveness of such techniques to most real world complex and large datasets. In this paper, we propose a novel reinforcement-learning (RL) based framework that takes a given vis-rec model and a time-budget from the user and identifies the best set of input statistics that would be most effective while generating the visual insights within a given time budget, using the given model. Using two state-of-the-art vis-rec models applied on three large real-world datasets, we show the effectiveness of our technique in significantly reducing time-to visualize with very small amount of introduced error. Our approach is about 10X times faster compared to the baseline approaches that introduce similar amounts of error.
format Preprint
id arxiv_https___arxiv_org_abs_2411_18657
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ScaleViz: Scaling Visualization Recommendation Models on Large Data
Ahmad, Ghazi Shazan
Agarwal, Shubham
Mitra, Subrata
Rossi, Ryan
Doshi, Manav
Porwal, Vibhor
Paila, Syam Manoj Kumar
Artificial Intelligence
Human-Computer Interaction
Machine Learning
Automated visualization recommendations (vis-rec) help users to derive crucial insights from new datasets. Typically, such automated vis-rec models first calculate a large number of statistics from the datasets and then use machine-learning models to score or classify multiple visualizations choices to recommend the most effective ones, as per the statistics. However, state-of-the art models rely on very large number of expensive statistics and therefore using such models on large datasets become infeasible due to prohibitively large computational time, limiting the effectiveness of such techniques to most real world complex and large datasets. In this paper, we propose a novel reinforcement-learning (RL) based framework that takes a given vis-rec model and a time-budget from the user and identifies the best set of input statistics that would be most effective while generating the visual insights within a given time budget, using the given model. Using two state-of-the-art vis-rec models applied on three large real-world datasets, we show the effectiveness of our technique in significantly reducing time-to visualize with very small amount of introduced error. Our approach is about 10X times faster compared to the baseline approaches that introduce similar amounts of error.
title ScaleViz: Scaling Visualization Recommendation Models on Large Data
topic Artificial Intelligence
Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2411.18657