High-Performance Star-M SVD for Big Data Compression

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Hussain, Md Taufique, Ballard, Grey, Devarakonda, Aditya, Eswar, Srinivas, Pesricha, Naman, Rao, Vishwas
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914569444655104
author Hussain, Md Taufique
Ballard, Grey
Devarakonda, Aditya
Eswar, Srinivas
Pesricha, Naman
Rao, Vishwas
author_facet Hussain, Md Taufique
Ballard, Grey
Devarakonda, Aditya
Eswar, Srinivas
Pesricha, Naman
Rao, Vishwas
contents In the era of big data, effectively compressing large datasets while performing complex mathematical operations is crucial. Tensor-based decomposition methods have shown superior compression capabilities with minimal loss of accuracy compared to traditional matrix methods. Under the star-M tensor framework, tensors can be decomposed in a matrix-mimetic way, including using the star-M SVD. This tensor SVD has optimality guarantees and has shown exceptional performance on specific types of data, but software implementations have been mostly limited to productivity-oriented languages. In this work, we present our development of a shared-memory parallel, high-performance solution designed to efficiently implement the underlying algorithms. This software will enable optimal compression of extensive scientific datasets, paving the way for enhanced data analysis and insights.
format Preprint
id arxiv_https___arxiv_org_abs_2605_16058
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle High-Performance Star-M SVD for Big Data Compression
Hussain, Md Taufique
Ballard, Grey
Devarakonda, Aditya
Eswar, Srinivas
Pesricha, Naman
Rao, Vishwas
Distributed, Parallel, and Cluster Computing
Mathematical Software
In the era of big data, effectively compressing large datasets while performing complex mathematical operations is crucial. Tensor-based decomposition methods have shown superior compression capabilities with minimal loss of accuracy compared to traditional matrix methods. Under the star-M tensor framework, tensors can be decomposed in a matrix-mimetic way, including using the star-M SVD. This tensor SVD has optimality guarantees and has shown exceptional performance on specific types of data, but software implementations have been mostly limited to productivity-oriented languages. In this work, we present our development of a shared-memory parallel, high-performance solution designed to efficiently implement the underlying algorithms. This software will enable optimal compression of extensive scientific datasets, paving the way for enhanced data analysis and insights.
title High-Performance Star-M SVD for Big Data Compression
topic Distributed, Parallel, and Cluster Computing
Mathematical Software
url https://arxiv.org/abs/2605.16058