Shape Arithmetic Expressions: Advancing Scientific Discovery Beyond Closed-Form Equations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kacprzyk, Krzysztof, van der Schaar, Mihaela
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911840396640256
author Kacprzyk, Krzysztof
van der Schaar, Mihaela
author_facet Kacprzyk, Krzysztof
van der Schaar, Mihaela
contents Symbolic regression has excelled in uncovering equations from physics, chemistry, biology, and related disciplines. However, its effectiveness becomes less certain when applied to experimental data lacking inherent closed-form expressions. Empirically derived relationships, such as entire stress-strain curves, may defy concise closed-form representation, compelling us to explore more adaptive modeling approaches that balance flexibility with interpretability. In our pursuit, we turn to Generalized Additive Models (GAMs), a widely used class of models known for their versatility across various domains. Although GAMs can capture non-linear relationships between variables and targets, they cannot capture intricate feature interactions. In this work, we investigate both of these challenges and propose a novel class of models, Shape Arithmetic Expressions (SHAREs), that fuses GAM's flexible shape functions with the complex feature interactions found in mathematical expressions. SHAREs also provide a unifying framework for both of these approaches. We also design a set of rules for constructing SHAREs that guarantee transparency of the found expressions beyond the standard constraints based on the model's size.
format Preprint
id arxiv_https___arxiv_org_abs_2404_09788
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Shape Arithmetic Expressions: Advancing Scientific Discovery Beyond Closed-Form Equations
Kacprzyk, Krzysztof
van der Schaar, Mihaela
Machine Learning
Symbolic regression has excelled in uncovering equations from physics, chemistry, biology, and related disciplines. However, its effectiveness becomes less certain when applied to experimental data lacking inherent closed-form expressions. Empirically derived relationships, such as entire stress-strain curves, may defy concise closed-form representation, compelling us to explore more adaptive modeling approaches that balance flexibility with interpretability. In our pursuit, we turn to Generalized Additive Models (GAMs), a widely used class of models known for their versatility across various domains. Although GAMs can capture non-linear relationships between variables and targets, they cannot capture intricate feature interactions. In this work, we investigate both of these challenges and propose a novel class of models, Shape Arithmetic Expressions (SHAREs), that fuses GAM's flexible shape functions with the complex feature interactions found in mathematical expressions. SHAREs also provide a unifying framework for both of these approaches. We also design a set of rules for constructing SHAREs that guarantee transparency of the found expressions beyond the standard constraints based on the model's size.
title Shape Arithmetic Expressions: Advancing Scientific Discovery Beyond Closed-Form Equations
topic Machine Learning
url https://arxiv.org/abs/2404.09788