Diversity By Design: Leveraging Distribution Matching for Offline Model-Based Optimization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yao, Michael S., Gee, James C., Bastani, Osbert
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912356868554752
author Yao, Michael S.
Gee, James C.
Bastani, Osbert
author_facet Yao, Michael S.
Gee, James C.
Bastani, Osbert
contents The goal of offline model-based optimization (MBO) is to propose new designs that maximize a reward function given only an offline dataset. However, an important desiderata is to also propose a diverse set of final candidates that capture many optimal and near-optimal design configurations. We propose Diversity in Adversarial Model-based Optimization (DynAMO) as a novel method to introduce design diversity as an explicit objective into any MBO problem. Our key insight is to formulate diversity as a distribution matching problem where the distribution of generated designs captures the inherent diversity contained within the offline dataset. Extensive experiments spanning multiple scientific domains show that DynAMO can be used with common optimization methods to significantly improve the diversity of proposed designs while still discovering high-quality candidates.
format Preprint
id arxiv_https___arxiv_org_abs_2501_18768
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Diversity By Design: Leveraging Distribution Matching for Offline Model-Based Optimization
Yao, Michael S.
Gee, James C.
Bastani, Osbert
Machine Learning
Artificial Intelligence
The goal of offline model-based optimization (MBO) is to propose new designs that maximize a reward function given only an offline dataset. However, an important desiderata is to also propose a diverse set of final candidates that capture many optimal and near-optimal design configurations. We propose Diversity in Adversarial Model-based Optimization (DynAMO) as a novel method to introduce design diversity as an explicit objective into any MBO problem. Our key insight is to formulate diversity as a distribution matching problem where the distribution of generated designs captures the inherent diversity contained within the offline dataset. Extensive experiments spanning multiple scientific domains show that DynAMO can be used with common optimization methods to significantly improve the diversity of proposed designs while still discovering high-quality candidates.
title Diversity By Design: Leveraging Distribution Matching for Offline Model-Based Optimization
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2501.18768