Generative Modeling for Mathematical Discovery

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ellenberg, Jordan S., Fraser-Taliente, Cristofero S., Harvey, Thomas R., Srivastava, Karan, Sutherland, Andrew V.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929761301823488
author Ellenberg, Jordan S.
Fraser-Taliente, Cristofero S.
Harvey, Thomas R.
Srivastava, Karan
Sutherland, Andrew V.
author_facet Ellenberg, Jordan S.
Fraser-Taliente, Cristofero S.
Harvey, Thomas R.
Srivastava, Karan
Sutherland, Andrew V.
contents We present a new implementation of the LLM-driven genetic algorithm {\it funsearch}, whose aim is to generate examples of interest to mathematicians and which has already had some success in problems in extremal combinatorics. Our implementation is designed to be useful in practice for working mathematicians; it does not require expertise in machine learning or access to high-performance computing resources. Applying {\it funsearch} to a new problem involves modifying a small segment of Python code and selecting a large language model (LLM) from one of many third-party providers. We benchmarked our implementation on three different problems, obtaining metrics that may inform applications of {\it funsearch} to new problems. Our results demonstrate that {\it funsearch} successfully learns in a variety of combinatorial and number-theoretic settings, and in some contexts learns principles that generalize beyond the problem originally trained on.
format Preprint
id arxiv_https___arxiv_org_abs_2503_11061
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Generative Modeling for Mathematical Discovery
Ellenberg, Jordan S.
Fraser-Taliente, Cristofero S.
Harvey, Thomas R.
Srivastava, Karan
Sutherland, Andrew V.
Machine Learning
Combinatorics
68T20
We present a new implementation of the LLM-driven genetic algorithm {\it funsearch}, whose aim is to generate examples of interest to mathematicians and which has already had some success in problems in extremal combinatorics. Our implementation is designed to be useful in practice for working mathematicians; it does not require expertise in machine learning or access to high-performance computing resources. Applying {\it funsearch} to a new problem involves modifying a small segment of Python code and selecting a large language model (LLM) from one of many third-party providers. We benchmarked our implementation on three different problems, obtaining metrics that may inform applications of {\it funsearch} to new problems. Our results demonstrate that {\it funsearch} successfully learns in a variety of combinatorial and number-theoretic settings, and in some contexts learns principles that generalize beyond the problem originally trained on.
title Generative Modeling for Mathematical Discovery
topic Machine Learning
Combinatorics
68T20
url https://arxiv.org/abs/2503.11061