Saved in:
Bibliographic Details
Main Authors: Løvbak, Emil, Blondeel, Frédéric, Lee, Adam, Vanroye, Lander, Van Barel, Andreas, Samaey, Giovanni
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2302.02778
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909289221718016
author Løvbak, Emil
Blondeel, Frédéric
Lee, Adam
Vanroye, Lander
Van Barel, Andreas
Samaey, Giovanni
author_facet Løvbak, Emil
Blondeel, Frédéric
Lee, Adam
Vanroye, Lander
Van Barel, Andreas
Samaey, Giovanni
contents In PDE-constrained optimization, one aims to find design parameters that minimize some objective, subject to the satisfaction of a partial differential equation. A major challenges is computing gradients of the objective to the design parameters, as applying the chain rule requires computing the Jacobian of the design parameters to the PDE's state. The adjoint method avoids this Jacobian by computing partial derivatives of a Lagrangian. Evaluating these derivatives requires the solution of a second PDE with the adjoint differential operator to the constraint, resulting in a backwards-in-time simulation. Particle-based Monte Carlo solvers are often used to compute the solution to high-dimensional PDEs. However, such solvers have the drawback of introducing noise to the computed results, thus requiring stochastic optimization methods. To guarantee convergence in this setting, both the constraint and adjoint Monte Carlo simulations should simulate the same particle trajectories. For large simulations, storing full paths from the constraint equation for re-use in the adjoint equation becomes infeasible due to memory limitations. In this paper, we provide a reversible extension to the family of permuted congruential pseudorandom number generators (PCG). We then use such a generator to recompute these time-reversed paths for the heat equation, avoiding these memory issues.
format Preprint
id arxiv_https___arxiv_org_abs_2302_02778
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Reversible random number generation for adjoint Monte Carlo simulation of the heat equation
Løvbak, Emil
Blondeel, Frédéric
Lee, Adam
Vanroye, Lander
Van Barel, Andreas
Samaey, Giovanni
Numerical Analysis
In PDE-constrained optimization, one aims to find design parameters that minimize some objective, subject to the satisfaction of a partial differential equation. A major challenges is computing gradients of the objective to the design parameters, as applying the chain rule requires computing the Jacobian of the design parameters to the PDE's state. The adjoint method avoids this Jacobian by computing partial derivatives of a Lagrangian. Evaluating these derivatives requires the solution of a second PDE with the adjoint differential operator to the constraint, resulting in a backwards-in-time simulation. Particle-based Monte Carlo solvers are often used to compute the solution to high-dimensional PDEs. However, such solvers have the drawback of introducing noise to the computed results, thus requiring stochastic optimization methods. To guarantee convergence in this setting, both the constraint and adjoint Monte Carlo simulations should simulate the same particle trajectories. For large simulations, storing full paths from the constraint equation for re-use in the adjoint equation becomes infeasible due to memory limitations. In this paper, we provide a reversible extension to the family of permuted congruential pseudorandom number generators (PCG). We then use such a generator to recompute these time-reversed paths for the heat equation, avoiding these memory issues.
title Reversible random number generation for adjoint Monte Carlo simulation of the heat equation
topic Numerical Analysis
url https://arxiv.org/abs/2302.02778