Geometric Neural Process Fields

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Yin, Wenzhe, Xiao, Zehao, Shen, Jiayi, Chen, Yunlu, Snoek, Cees G. M., Sonke, Jan-Jakob, Gavves, Efstratios
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916597399027712
author Yin, Wenzhe
Xiao, Zehao
Shen, Jiayi
Chen, Yunlu
Snoek, Cees G. M.
Sonke, Jan-Jakob
Gavves, Efstratios
author_facet Yin, Wenzhe
Xiao, Zehao
Shen, Jiayi
Chen, Yunlu
Snoek, Cees G. M.
Sonke, Jan-Jakob
Gavves, Efstratios
contents This paper addresses the challenge of Neural Field (NeF) generalization, where models must efficiently adapt to new signals given only a few observations. To tackle this, we propose Geometric Neural Process Fields (G-NPF), a probabilistic framework for neural radiance fields that explicitly captures uncertainty. We formulate NeF generalization as a probabilistic problem, enabling direct inference of NeF function distributions from limited context observations. To incorporate structural inductive biases, we introduce a set of geometric bases that encode spatial structure and facilitate the inference of NeF function distributions. Building on these bases, we design a hierarchical latent variable model, allowing G-NPF to integrate structural information across multiple spatial levels and effectively parameterize INR functions. This hierarchical approach improves generalization to novel scenes and unseen signals. Experiments on novel-view synthesis for 3D scenes, as well as 2D image and 1D signal regression, demonstrate the effectiveness of our method in capturing uncertainty and leveraging structural information for improved generalization.
format Preprint
id arxiv_https___arxiv_org_abs_2502_02338
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Geometric Neural Process Fields
Yin, Wenzhe
Xiao, Zehao
Shen, Jiayi
Chen, Yunlu
Snoek, Cees G. M.
Sonke, Jan-Jakob
Gavves, Efstratios
Computer Vision and Pattern Recognition
Machine Learning
This paper addresses the challenge of Neural Field (NeF) generalization, where models must efficiently adapt to new signals given only a few observations. To tackle this, we propose Geometric Neural Process Fields (G-NPF), a probabilistic framework for neural radiance fields that explicitly captures uncertainty. We formulate NeF generalization as a probabilistic problem, enabling direct inference of NeF function distributions from limited context observations. To incorporate structural inductive biases, we introduce a set of geometric bases that encode spatial structure and facilitate the inference of NeF function distributions. Building on these bases, we design a hierarchical latent variable model, allowing G-NPF to integrate structural information across multiple spatial levels and effectively parameterize INR functions. This hierarchical approach improves generalization to novel scenes and unseen signals. Experiments on novel-view synthesis for 3D scenes, as well as 2D image and 1D signal regression, demonstrate the effectiveness of our method in capturing uncertainty and leveraging structural information for improved generalization.
title Geometric Neural Process Fields
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2502.02338