Transition Path Sampling with Improved Off-Policy Training of Diffusion Path Samplers

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Seong, Kiyoung, Park, Seonghyun, Kim, Seonghwan, Kim, Woo Youn, Ahn, Sungsoo
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912204790431744
author Seong, Kiyoung
Park, Seonghyun
Kim, Seonghwan
Kim, Woo Youn
Ahn, Sungsoo
author_facet Seong, Kiyoung
Park, Seonghyun
Kim, Seonghwan
Kim, Woo Youn
Ahn, Sungsoo
contents Understanding transition pathways between two meta-stable states of a molecular system is crucial to advance drug discovery and material design. However, unbiased molecular dynamics (MD) simulations are computationally infeasible because of the high energy barriers that separate these states. Although recent machine learning techniques are proposed to sample rare events, they are often limited to simple systems and rely on collective variables (CVs) derived from costly domain expertise. In this paper, we introduce a novel approach that trains diffusion path samplers (DPS) to address the transition path sampling (TPS) problem without requiring CVs. We reformulate the problem as an amortized sampling from the transition path distribution by minimizing the log-variance divergence between the path distribution induced by DPS and the transition path distribution. Based on the log-variance divergence, we propose learnable control variates to reduce the variance of gradient estimators and the off-policy training objective with replay buffers and simulated annealing techniques to improve sample efficiency and diversity. We also propose a scale-based equivariant parameterization of the bias forces to ensure scalability for large systems. We extensively evaluate our approach, termed TPS-DPS, on a synthetic system, small peptide, and challenging fast-folding proteins, demonstrating that it produces more realistic and diverse transition pathways than existing baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2405_19961
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Transition Path Sampling with Improved Off-Policy Training of Diffusion Path Samplers
Seong, Kiyoung
Park, Seonghyun
Kim, Seonghwan
Kim, Woo Youn
Ahn, Sungsoo
Machine Learning
Understanding transition pathways between two meta-stable states of a molecular system is crucial to advance drug discovery and material design. However, unbiased molecular dynamics (MD) simulations are computationally infeasible because of the high energy barriers that separate these states. Although recent machine learning techniques are proposed to sample rare events, they are often limited to simple systems and rely on collective variables (CVs) derived from costly domain expertise. In this paper, we introduce a novel approach that trains diffusion path samplers (DPS) to address the transition path sampling (TPS) problem without requiring CVs. We reformulate the problem as an amortized sampling from the transition path distribution by minimizing the log-variance divergence between the path distribution induced by DPS and the transition path distribution. Based on the log-variance divergence, we propose learnable control variates to reduce the variance of gradient estimators and the off-policy training objective with replay buffers and simulated annealing techniques to improve sample efficiency and diversity. We also propose a scale-based equivariant parameterization of the bias forces to ensure scalability for large systems. We extensively evaluate our approach, termed TPS-DPS, on a synthetic system, small peptide, and challenging fast-folding proteins, demonstrating that it produces more realistic and diverse transition pathways than existing baselines.
title Transition Path Sampling with Improved Off-Policy Training of Diffusion Path Samplers
topic Machine Learning
url https://arxiv.org/abs/2405.19961