A Data Aggregation Visualization System supported by Processing-in-Memory

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kim, Junyoung, Balakumar, Madhulika, Ross, Kenneth
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910870096838656
author Kim, Junyoung
Balakumar, Madhulika
Ross, Kenneth
author_facet Kim, Junyoung
Balakumar, Madhulika
Ross, Kenneth
contents Data visualization of aggregation queries is one of the most common ways of doing data exploration and data science as it can help identify correlations and patterns in the data. We propose DIVAN, a system that automatically normalizes the one-dimensional axes by frequency to generate large numbers of two-dimensional visualizations. DIVAN normalizes the input data via binning to allocate more pixels to data values that appear more frequently in the dataset. DIVAN can utilize either CPUs or Processing-in-Memory (PIM) architectures to quickly calculate aggregates to support the visualizations. On real world datasets, we show that DIVAN generates visualizations that highlight patterns and correlations, some expected and some unexpected. By using PIM, we can calculate aggregates 45%-64% faster than modern CPUs on large datasets. For use cases with 100 million rows and 32 columns, our system is able to compute 4,960 aggregates (each of size 128x128x128) in about a minute.
format Preprint
id arxiv_https___arxiv_org_abs_2503_08463
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Data Aggregation Visualization System supported by Processing-in-Memory
Kim, Junyoung
Balakumar, Madhulika
Ross, Kenneth
Computer Vision and Pattern Recognition
H.2.8; I.5.5
Data visualization of aggregation queries is one of the most common ways of doing data exploration and data science as it can help identify correlations and patterns in the data. We propose DIVAN, a system that automatically normalizes the one-dimensional axes by frequency to generate large numbers of two-dimensional visualizations. DIVAN normalizes the input data via binning to allocate more pixels to data values that appear more frequently in the dataset. DIVAN can utilize either CPUs or Processing-in-Memory (PIM) architectures to quickly calculate aggregates to support the visualizations. On real world datasets, we show that DIVAN generates visualizations that highlight patterns and correlations, some expected and some unexpected. By using PIM, we can calculate aggregates 45%-64% faster than modern CPUs on large datasets. For use cases with 100 million rows and 32 columns, our system is able to compute 4,960 aggregates (each of size 128x128x128) in about a minute.
title A Data Aggregation Visualization System supported by Processing-in-Memory
topic Computer Vision and Pattern Recognition
H.2.8; I.5.5
url https://arxiv.org/abs/2503.08463