Saved in:
Bibliographic Details
Main Authors: Lobashev, Alexander, Guskov, Dmitry, Polovnikov, Kirill
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2404.07029
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908386837135360
author Lobashev, Alexander
Guskov, Dmitry
Polovnikov, Kirill
author_facet Lobashev, Alexander
Guskov, Dmitry
Polovnikov, Kirill
contents Fractional Brownian motion (fBm) features both randomness and strong scale-free correlations, challenging generative models to reproduce the intrinsic memory characterizing the underlying stochastic process. Here we examine a zoo of diffusion-based inpainting methods on a specific dataset of corrupted images, which represent incomplete Euclidean distance matrices (EDMs) of fBm at various memory exponents $H$. Our dataset implies uniqueness of the data imputation in the regime of low missing ratio, where the remaining partial graph is rigid, providing the ground truth for the inpainting. We find that the conditional diffusion generation readily reproduces the built-in correlations of fBm paths in different memory regimes (i.e., for sub-, Brownian and super-diffusion trajectories), providing a robust tool for the statistical imputation at high missing ratio. Furthermore, while diffusion models have been recently shown to memorize samples from the training database, we demonstrate that diffusion behaves qualitatively different from the database search and thus generalize rather than memorize the training dataset. As a biological application, we apply our fBm-trained diffusion model for the imputation of microscopy-derived distance matrices of chromosomal segments (FISH data) - incomplete due to experimental imperfections - and demonstrate its superiority over the standard approaches used in bioinformatics.
format Preprint
id arxiv_https___arxiv_org_abs_2404_07029
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generative inpainting of incomplete Euclidean distance matrices of trajectories generated by a fractional Brownian motion
Lobashev, Alexander
Guskov, Dmitry
Polovnikov, Kirill
Computer Vision and Pattern Recognition
68T07
I.2.0
Fractional Brownian motion (fBm) features both randomness and strong scale-free correlations, challenging generative models to reproduce the intrinsic memory characterizing the underlying stochastic process. Here we examine a zoo of diffusion-based inpainting methods on a specific dataset of corrupted images, which represent incomplete Euclidean distance matrices (EDMs) of fBm at various memory exponents $H$. Our dataset implies uniqueness of the data imputation in the regime of low missing ratio, where the remaining partial graph is rigid, providing the ground truth for the inpainting. We find that the conditional diffusion generation readily reproduces the built-in correlations of fBm paths in different memory regimes (i.e., for sub-, Brownian and super-diffusion trajectories), providing a robust tool for the statistical imputation at high missing ratio. Furthermore, while diffusion models have been recently shown to memorize samples from the training database, we demonstrate that diffusion behaves qualitatively different from the database search and thus generalize rather than memorize the training dataset. As a biological application, we apply our fBm-trained diffusion model for the imputation of microscopy-derived distance matrices of chromosomal segments (FISH data) - incomplete due to experimental imperfections - and demonstrate its superiority over the standard approaches used in bioinformatics.
title Generative inpainting of incomplete Euclidean distance matrices of trajectories generated by a fractional Brownian motion
topic Computer Vision and Pattern Recognition
68T07
I.2.0
url https://arxiv.org/abs/2404.07029