Data augmentation using diffusion models to enhance inverse Ising inference

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lim, Yechan, Lee, Sangwon, Jo, Junghyo
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912272878665728
author Lim, Yechan
Lee, Sangwon
Jo, Junghyo
author_facet Lim, Yechan
Lee, Sangwon
Jo, Junghyo
contents Identifying model parameters from observed configurations poses a fundamental challenge in data science, especially with limited data. Recently, diffusion models have emerged as a novel paradigm in generative machine learning, capable of producing new samples that closely mimic observed data. These models learn the gradient of model probabilities, bypassing the need for cumbersome calculations of partition functions across all possible configurations. We explore whether diffusion models can enhance parameter inference by augmenting small datasets. Our findings demonstrate this potential through a synthetic task involving inverse Ising inference and a real-world application of reconstructing missing values in neural activity data. This study serves as a proof-of-concept for using diffusion models for data augmentation in physics-related problems, thereby opening new avenues in data science.
format Preprint
id arxiv_https___arxiv_org_abs_2503_10154
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Data augmentation using diffusion models to enhance inverse Ising inference
Lim, Yechan
Lee, Sangwon
Jo, Junghyo
Data Analysis, Statistics and Probability
Machine Learning
Identifying model parameters from observed configurations poses a fundamental challenge in data science, especially with limited data. Recently, diffusion models have emerged as a novel paradigm in generative machine learning, capable of producing new samples that closely mimic observed data. These models learn the gradient of model probabilities, bypassing the need for cumbersome calculations of partition functions across all possible configurations. We explore whether diffusion models can enhance parameter inference by augmenting small datasets. Our findings demonstrate this potential through a synthetic task involving inverse Ising inference and a real-world application of reconstructing missing values in neural activity data. This study serves as a proof-of-concept for using diffusion models for data augmentation in physics-related problems, thereby opening new avenues in data science.
title Data augmentation using diffusion models to enhance inverse Ising inference
topic Data Analysis, Statistics and Probability
Machine Learning
url https://arxiv.org/abs/2503.10154