Generative Latent Diffusion for Efficient Spatiotemporal Data Reduction

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Xiao, Zhu, Liangji, Rangarajan, Anand, Ranka, Sanjay
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915370125754368
author Li, Xiao
Zhu, Liangji
Rangarajan, Anand
Ranka, Sanjay
author_facet Li, Xiao
Zhu, Liangji
Rangarajan, Anand
Ranka, Sanjay
contents Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representation. However, their limited controllability and reconstruction accuracy restrict their practical application to data compression. In this work, we propose an efficient latent diffusion framework that bridges this gap by combining a variational autoencoder with a conditional diffusion model. Our method compresses only a small number of keyframes into latent space and uses them as conditioning inputs to reconstruct the remaining frames via generative interpolation, eliminating the need to store latent representations for every frame. This approach enables accurate spatiotemporal reconstruction while significantly reducing storage costs. Experimental results across multiple datasets show that our method achieves up to 10 times higher compression ratios than rule-based state-of-the-art compressors such as SZ3, and up to 63 percent better performance than leading learning-based methods under the same reconstruction error.
format Preprint
id arxiv_https___arxiv_org_abs_2507_02129
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Generative Latent Diffusion for Efficient Spatiotemporal Data Reduction
Li, Xiao
Zhu, Liangji
Rangarajan, Anand
Ranka, Sanjay
Machine Learning
Computer Vision and Pattern Recognition
Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representation. However, their limited controllability and reconstruction accuracy restrict their practical application to data compression. In this work, we propose an efficient latent diffusion framework that bridges this gap by combining a variational autoencoder with a conditional diffusion model. Our method compresses only a small number of keyframes into latent space and uses them as conditioning inputs to reconstruct the remaining frames via generative interpolation, eliminating the need to store latent representations for every frame. This approach enables accurate spatiotemporal reconstruction while significantly reducing storage costs. Experimental results across multiple datasets show that our method achieves up to 10 times higher compression ratios than rule-based state-of-the-art compressors such as SZ3, and up to 63 percent better performance than leading learning-based methods under the same reconstruction error.
title Generative Latent Diffusion for Efficient Spatiotemporal Data Reduction
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.02129