Saved in:
Bibliographic Details
Main Authors: Li, Mo, Lu, QiQi, Lund, Robert, Shi, Xueheng
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.14801
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915870603739136
author Li, Mo
Lu, QiQi
Lund, Robert
Shi, Xueheng
author_facet Li, Mo
Lu, QiQi
Lund, Robert
Shi, Xueheng
contents Many statistical problems involve optimization over a discrete parameter space having an unknown dimension. In such settings, gradient-based methods often fail due to the non-differentiability of the objective function or a non-convex or massive search space with an objective function having many local maxima/minima. This paper presents GAReg, a unified genetic algorithm package that handles discrete optimization regression problems, which works well when standard algorithms are unjustified. GAReg provides a compact chromosome representation supporting optimal knot placement for regression splines, best-subset regression variable selection, and related problems. The package allows for uniform initialization, constraint-preserving crossover and mutation, steady-state replacement, and an optional island-model parallelization. GAReg efficiently searches high-dimensional model spaces, providing near-optimal solutions in settings where exhaustive enumeration or integer or dynamic programming approaches are infeasible.
format Preprint
id arxiv_https___arxiv_org_abs_2603_14801
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Genetic Algorithms in Regression
Li, Mo
Lu, QiQi
Lund, Robert
Shi, Xueheng
Applications
Computation
Many statistical problems involve optimization over a discrete parameter space having an unknown dimension. In such settings, gradient-based methods often fail due to the non-differentiability of the objective function or a non-convex or massive search space with an objective function having many local maxima/minima. This paper presents GAReg, a unified genetic algorithm package that handles discrete optimization regression problems, which works well when standard algorithms are unjustified. GAReg provides a compact chromosome representation supporting optimal knot placement for regression splines, best-subset regression variable selection, and related problems. The package allows for uniform initialization, constraint-preserving crossover and mutation, steady-state replacement, and an optional island-model parallelization. GAReg efficiently searches high-dimensional model spaces, providing near-optimal solutions in settings where exhaustive enumeration or integer or dynamic programming approaches are infeasible.
title Genetic Algorithms in Regression
topic Applications
Computation
url https://arxiv.org/abs/2603.14801