Saved in:
Bibliographic Details
Main Authors: Choudhary, Harsh, Gupta, Chandan, Kungurtsev, Vyacheslav, Leok, Melvin, Korpas, Georgios
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.11138
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917134657912832
author Choudhary, Harsh
Gupta, Chandan
Kungurtsev, Vyacheslav
Leok, Melvin
Korpas, Georgios
author_facet Choudhary, Harsh
Gupta, Chandan
Kungurtsev, Vyacheslav
Leok, Melvin
Korpas, Georgios
contents Many important physical systems can be described as the evolution of a Hamiltonian system, which has the important property of being conservative, that is, energy is conserved throughout the evolution. Physics Informed Neural Networks and in particular Hamiltonian Neural Networks have emerged as a mechanism to incorporate structural inductive bias into the NN model. By ensuring physical invariances are conserved, the models exhibit significantly better sample complexity and out-of-distribution accuracy than standard NNs. Learning the Hamiltonian as a function of its canonical variables, typically position and velocity, from sample observations of the system thus becomes a critical task in system identification and long-term prediction of system behavior. However, to truly preserve the long-run physical conservation properties of Hamiltonian systems, one must use symplectic integrators for a forward pass of the system's simulation. While symplectic schemes have been used in the literature, they are thus far limited to situations when they reduce to explicit algorithms, which include the case of separable Hamiltonians or augmented non-separable Hamiltonians. We extend it to generalized non-separable Hamiltonians, and noting the self-adjoint property of symplectic integrators, we bypass computationally intensive backpropagation through an ODE solver. We show that the method is robust to noise and provides a good approximation of the system Hamiltonian when the state variables are sampled from a noisy observation. In the numerical results, we show the performance of the method concerning Hamiltonian reconstruction and conservation, indicating its particular advantage for non-separable systems.
format Preprint
id arxiv_https___arxiv_org_abs_2409_11138
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Generalized Hamiltonians using fully Symplectic Mappings
Choudhary, Harsh
Gupta, Chandan
Kungurtsev, Vyacheslav
Leok, Melvin
Korpas, Georgios
Machine Learning
Artificial Intelligence
Many important physical systems can be described as the evolution of a Hamiltonian system, which has the important property of being conservative, that is, energy is conserved throughout the evolution. Physics Informed Neural Networks and in particular Hamiltonian Neural Networks have emerged as a mechanism to incorporate structural inductive bias into the NN model. By ensuring physical invariances are conserved, the models exhibit significantly better sample complexity and out-of-distribution accuracy than standard NNs. Learning the Hamiltonian as a function of its canonical variables, typically position and velocity, from sample observations of the system thus becomes a critical task in system identification and long-term prediction of system behavior. However, to truly preserve the long-run physical conservation properties of Hamiltonian systems, one must use symplectic integrators for a forward pass of the system's simulation. While symplectic schemes have been used in the literature, they are thus far limited to situations when they reduce to explicit algorithms, which include the case of separable Hamiltonians or augmented non-separable Hamiltonians. We extend it to generalized non-separable Hamiltonians, and noting the self-adjoint property of symplectic integrators, we bypass computationally intensive backpropagation through an ODE solver. We show that the method is robust to noise and provides a good approximation of the system Hamiltonian when the state variables are sampled from a noisy observation. In the numerical results, we show the performance of the method concerning Hamiltonian reconstruction and conservation, indicating its particular advantage for non-separable systems.
title Learning Generalized Hamiltonians using fully Symplectic Mappings
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2409.11138