Learning embeddings of non-linear PDEs: the Burgers' equation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Tarancón-Álvarez, Pedro, Sarieddine, Leonid, Protopapas, Pavlos, Jimenez, Raul
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912954295779328
author Tarancón-Álvarez, Pedro
Sarieddine, Leonid
Protopapas, Pavlos
Jimenez, Raul
author_facet Tarancón-Álvarez, Pedro
Sarieddine, Leonid
Protopapas, Pavlos
Jimenez, Raul
contents Embeddings provide low-dimensional representations that organize complex function spaces and support generalization. They provide a geometric representation that supports efficient retrieval, comparison, and generalization. In this work we generalize the concept to Physics Informed Neural Networks. We present a method to construct solution embedding spaces of nonlinear partial differential equations using a multi-head setup, and extract non-degenerate information from them using principal component analysis (PCA). We test this method by applying it to viscous Burgers' equation, which is solved simultaneously for a family of initial conditions and values of the viscosity. A shared network body learns a latent embedding of the solution space, while linear heads map this embedding to individual realizations. By enforcing orthogonality constraints on the heads, we obtain a principal-component decomposition of the latent space that is robust to training degeneracies and admits a direct physical interpretation. The obtained components for Burgers' equation exhibit rapid saturation, indicating that a small number of latent modes captures the dominant features of the dynamics.
format Preprint
id arxiv_https___arxiv_org_abs_2603_07812
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Learning embeddings of non-linear PDEs: the Burgers' equation
Tarancón-Álvarez, Pedro
Sarieddine, Leonid
Protopapas, Pavlos
Jimenez, Raul
Analysis of PDEs
Artificial Intelligence
Machine Learning
Embeddings provide low-dimensional representations that organize complex function spaces and support generalization. They provide a geometric representation that supports efficient retrieval, comparison, and generalization. In this work we generalize the concept to Physics Informed Neural Networks. We present a method to construct solution embedding spaces of nonlinear partial differential equations using a multi-head setup, and extract non-degenerate information from them using principal component analysis (PCA). We test this method by applying it to viscous Burgers' equation, which is solved simultaneously for a family of initial conditions and values of the viscosity. A shared network body learns a latent embedding of the solution space, while linear heads map this embedding to individual realizations. By enforcing orthogonality constraints on the heads, we obtain a principal-component decomposition of the latent space that is robust to training degeneracies and admits a direct physical interpretation. The obtained components for Burgers' equation exhibit rapid saturation, indicating that a small number of latent modes captures the dominant features of the dynamics.
title Learning embeddings of non-linear PDEs: the Burgers' equation
topic Analysis of PDEs
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2603.07812