SpaceMesh: A Continuous Representation for Learning Manifold Surface Meshes

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Shen, Tianchang, Li, Zhaoshuo, Law, Marc, Atzmon, Matan, Fidler, Sanja, Lucas, James, Gao, Jun, Sharp, Nicholas
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909487300870144
author Shen, Tianchang
Li, Zhaoshuo
Law, Marc
Atzmon, Matan
Fidler, Sanja
Lucas, James
Gao, Jun
Sharp, Nicholas
author_facet Shen, Tianchang
Li, Zhaoshuo
Law, Marc
Atzmon, Matan
Fidler, Sanja
Lucas, James
Gao, Jun
Sharp, Nicholas
contents Meshes are ubiquitous in visual computing and simulation, yet most existing machine learning techniques represent meshes only indirectly, e.g. as the level set of a scalar field or deformation of a template, or as a disordered triangle soup lacking local structure. This work presents a scheme to directly generate manifold, polygonal meshes of complex connectivity as the output of a neural network. Our key innovation is to define a continuous latent connectivity space at each mesh vertex, which implies the discrete mesh. In particular, our vertex embeddings generate cyclic neighbor relationships in a halfedge mesh representation, which gives a guarantee of edge-manifoldness and the ability to represent general polygonal meshes. This representation is well-suited to machine learning and stochastic optimization, without restriction on connectivity or topology. We first explore the basic properties of this representation, then use it to fit distributions of meshes from large datasets. The resulting models generate diverse meshes with tessellation structure learned from the dataset population, with concise details and high-quality mesh elements. In applications, this approach not only yields high-quality outputs from generative models, but also enables directly learning challenging geometry processing tasks such as mesh repair.
format Preprint
id arxiv_https___arxiv_org_abs_2409_20562
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SpaceMesh: A Continuous Representation for Learning Manifold Surface Meshes
Shen, Tianchang
Li, Zhaoshuo
Law, Marc
Atzmon, Matan
Fidler, Sanja
Lucas, James
Gao, Jun
Sharp, Nicholas
Computer Vision and Pattern Recognition
Graphics
Machine Learning
Meshes are ubiquitous in visual computing and simulation, yet most existing machine learning techniques represent meshes only indirectly, e.g. as the level set of a scalar field or deformation of a template, or as a disordered triangle soup lacking local structure. This work presents a scheme to directly generate manifold, polygonal meshes of complex connectivity as the output of a neural network. Our key innovation is to define a continuous latent connectivity space at each mesh vertex, which implies the discrete mesh. In particular, our vertex embeddings generate cyclic neighbor relationships in a halfedge mesh representation, which gives a guarantee of edge-manifoldness and the ability to represent general polygonal meshes. This representation is well-suited to machine learning and stochastic optimization, without restriction on connectivity or topology. We first explore the basic properties of this representation, then use it to fit distributions of meshes from large datasets. The resulting models generate diverse meshes with tessellation structure learned from the dataset population, with concise details and high-quality mesh elements. In applications, this approach not only yields high-quality outputs from generative models, but also enables directly learning challenging geometry processing tasks such as mesh repair.
title SpaceMesh: A Continuous Representation for Learning Manifold Surface Meshes
topic Computer Vision and Pattern Recognition
Graphics
Machine Learning
url https://arxiv.org/abs/2409.20562