Neural Gaussian Scale-Space Fields

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mujkanovic, Felix, Nsampi, Ntumba Elie, Theobalt, Christian, Seidel, Hans-Peter, Leimkühler, Thomas
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913438996889600
author Mujkanovic, Felix
Nsampi, Ntumba Elie
Theobalt, Christian
Seidel, Hans-Peter
Leimkühler, Thomas
author_facet Mujkanovic, Felix
Nsampi, Ntumba Elie
Theobalt, Christian
Seidel, Hans-Peter
Leimkühler, Thomas
contents Gaussian scale spaces are a cornerstone of signal representation and processing, with applications in filtering, multiscale analysis, anti-aliasing, and many more. However, obtaining such a scale space is costly and cumbersome, in particular for continuous representations such as neural fields. We present an efficient and lightweight method to learn the fully continuous, anisotropic Gaussian scale space of an arbitrary signal. Based on Fourier feature modulation and Lipschitz bounding, our approach is trained self-supervised, i.e., training does not require any manual filtering. Our neural Gaussian scale-space fields faithfully capture multiscale representations across a broad range of modalities, and support a diverse set of applications. These include images, geometry, light-stage data, texture anti-aliasing, and multiscale optimization.
format Preprint
id arxiv_https___arxiv_org_abs_2405_20980
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Neural Gaussian Scale-Space Fields
Mujkanovic, Felix
Nsampi, Ntumba Elie
Theobalt, Christian
Seidel, Hans-Peter
Leimkühler, Thomas
Computer Vision and Pattern Recognition
Graphics
Machine Learning
Gaussian scale spaces are a cornerstone of signal representation and processing, with applications in filtering, multiscale analysis, anti-aliasing, and many more. However, obtaining such a scale space is costly and cumbersome, in particular for continuous representations such as neural fields. We present an efficient and lightweight method to learn the fully continuous, anisotropic Gaussian scale space of an arbitrary signal. Based on Fourier feature modulation and Lipschitz bounding, our approach is trained self-supervised, i.e., training does not require any manual filtering. Our neural Gaussian scale-space fields faithfully capture multiscale representations across a broad range of modalities, and support a diverse set of applications. These include images, geometry, light-stage data, texture anti-aliasing, and multiscale optimization.
title Neural Gaussian Scale-Space Fields
topic Computer Vision and Pattern Recognition
Graphics
Machine Learning
url https://arxiv.org/abs/2405.20980