Cover Image

Bilevel optimization for learning hyperparameters: Application to solving PDEs and inverse problems with Gaussian processes

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nelsen, Nicholas H., Owhadi, Houman, Stuart, Andrew M., Yang, Xianjin, Zou, Zongren
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computational Physics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Solving Functional PDEs with Gaussian Processes and Applications to Functional Renormalization Group Equations
by: Yang, Xianjin, et al.
Published: (2025)

A Mini-Batch Method for Solving Nonlinear PDEs with Gaussian Processes
by: Yang, Xianjin, et al.
Published: (2023)

Solving Roughly Forced Nonlinear PDEs via Misspecified Kernel Methods and Neural Networks
by: Baptista, Ricardo, et al.
Published: (2025)

A Dynamics-Informed Gaussian Process Framework for 2D Stochastic Navier-Stokes via Quasi-Gaussianity
by: Hamzi, Boumediene, et al.
Published: (2025)

Operator learning meets inverse problems: A probabilistic perspective
by: Nelsen, Nicholas H., et al.
Published: (2025)

Tensor Gaussian Processes: Efficient Solvers for Nonlinear PDEs
by: Yuan, Qiwei, et al.
Published: (2025)

Gaussian Measures Conditioned on Nonlinear Observations: Consistency, MAP Estimators, and Simulation
by: Chen, Yifan, et al.
Published: (2024)

HJ-sampler: A Bayesian sampler for inverse problems of a stochastic process by leveraging Hamilton-Jacobi PDEs and score-based generative models
by: Meng, Tingwei, et al.
Published: (2024)

Gaussian process policy iteration with additive Schwarz acceleration for forward and inverse HJB and mean field game problems
by: Yang, Xianjin, et al.
Published: (2025)

Sparse Cholesky Factorization for Solving Nonlinear PDEs via Gaussian Processes
by: Chen, Yifan, et al.
Published: (2023)

Kolmogorov n-Widths for Multitask Physics-Informed Machine Learning (PIML) Methods: Towards Robust Metrics
by: Penwarden, Michael, et al.
Published: (2024)

Toward Efficient Kernel-Based Solvers for Nonlinear PDEs
by: Xu, Zhitong, et al.
Published: (2024)

Operator Learning with Gaussian Processes
by: Mora, Carlos, et al.
Published: (2024)

Kernel Methods for Some Transport Equations with Application to Learning Kernels for the Approximation of Koopman Eigenfunctions: A Unified Approach via Variational Methods, Green's Functions and the Method of Characteristics
by: Hamzi, Boumediene, et al.
Published: (2026)

Bayesian autoregression to optimize temporal Matérn kernel Gaussian process hyperparameters
by: Kouw, Wouter M.
Published: (2025)

Kernel Methods for Stochastic Dynamical Systems with Application to Koopman Eigenfunctions: Feynman-Kac Representations and RKHS Approximation
by: Hamzi, Boumediene, et al.
Published: (2026)

Leveraging Hamilton-Jacobi PDEs with time-dependent Hamiltonians for continual scientific machine learning
by: Chen, Paula, et al.
Published: (2023)

Two-step hyperparameter optimization method: Accelerating hyperparameter search by using a fraction of a training dataset
by: Yu, Sungduk, et al.
Published: (2023)

Learning where to learn: Training data distribution optimization for scientific machine learning
by: Guerra, Nicolas, et al.
Published: (2025)

Bridging Algorithmic Information Theory and Machine Learning: A New Approach to Kernel Learning
by: Hamzi, Boumediene, et al.
Published: (2023)

KROM: Kernelized Reduced Order Modeling
by: Bacho, Aras, et al.
Published: (2026)

Kernel Sum of Squares for Data Adapted Kernel Learning of Dynamical Systems from Data: A global optimization approach
by: Lengyel, Daniel, et al.
Published: (2024)

Operator Learning Using Random Features: A Tool for Scientific Computing
by: Nelsen, Nicholas H., et al.
Published: (2024)

Learning and discovering multiple solutions using physics-informed neural networks with random initialization and deep ensemble
by: Zou, Zongren, et al.
Published: (2025)

Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dots
by: Bourdais, Théo, et al.
Published: (2023)

Pruning Deep Neural Networks via a Combination of the Marchenko-Pastur Distribution and Regularization
by: Berlyand, Leonid, et al.
Published: (2025)

Physics-informed neural networks to solve inverse problems in unbounded domains
by: Pérez-Bernal, Gregorio, et al.
Published: (2025)

A Hessian-informed hyperparameter optimization for differential learning rate
by: Xu, Shiyun, et al.
Published: (2025)

Dictionary learning for Kernel EDMD
by: Bolager, Erik Lien, et al.
Published: (2026)

Adaptive Kernel Selection for Kernelized Diffusion Maps
by: Aboussaad, Othmane, et al.
Published: (2026)

Fluids You Can Trust: Property-Preserving Operator Learning for Incompressible Flows
by: Sharma, Ramansh, et al.
Published: (2026)

Be aware of overfitting by hyperparameter optimization!
by: Tetko, Igor V., et al.
Published: (2024)

Operator Learning at Machine Precision
by: Bacho, Aras, et al.
Published: (2025)

Uncertainty Quantification in PINNs for Turbulent Flows: Bayesian Inference and Repulsive Ensembles
by: Shukla, Khemraj, et al.
Published: (2026)

Fast meta-solvers for 3D complex-shape scatterers using neural operators trained on a non-scattering problem
by: Lee, Youngkyu, et al.
Published: (2024)

Beyond algorithm hyperparameters: on preprocessing hyperparameters and associated pitfalls in machine learning applications
by: Sauer, Christina, et al.
Published: (2024)

Leveraging viscous Hamilton-Jacobi PDEs for uncertainty quantification in scientific machine learning
by: Zou, Zongren, et al.
Published: (2024)

A comprehensive and FAIR comparison between MLP and KAN representations for differential equations and operator networks
by: Shukla, Khemraj, et al.
Published: (2024)

Learning dynamical systems from data: A simple cross-validation perspective, part III: Irregularly-Sampled Time Series
by: Lee, Jonghyeon, et al.
Published: (2021)

An adaptively inexact first-order method for bilevel optimization with application to hyperparameter learning
by: Salehi, Mohammad Sadegh, et al.
Published: (2023)