A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Yisong, Cheng, Ran, Yi, Guoxing, Tan, Kay Chen
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915712246743040
author Zhang, Yisong
Cheng, Ran
Yi, Guoxing
Tan, Kay Chen
author_facet Zhang, Yisong
Cheng, Ran
Yi, Guoxing
Tan, Kay Chen
contents Large Language Models (LLMs) possess substantial reasoning capabilities and are increasingly applied to optimization tasks, particularly in synergy with evolutionary computation. However, while recent surveys have explored specific aspects of this domain, they lack an integrative perspective that connects problem modeling with solving workflows. To address this gap, we present a systematic review of recent developments and organize them within a structured framework. First, we classify existing research into two primary stages: LLMs for optimization modeling and LLMs for optimization solving. Second, we divide the latter into three paradigms based on the role of the LLM: stand-alone optimizers, low-level components embedded within algorithms, and high-level managers for algorithm selection and generation. Third, for each category, we analyze representative methods, distill technical challenges, and examine their interplay with traditional approaches. Finally, we review interdisciplinary applications across the natural sciences, engineering, and machine learning. Based on this analysis, we highlight key limitations and point toward future directions for developing self-evolving agentic ecosystems. An up-to-date collection of related literature is maintained at https://github.com/ishmael233/LLM4OPT.
format Preprint
id arxiv_https___arxiv_org_abs_2509_08269
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving
Zhang, Yisong
Cheng, Ran
Yi, Guoxing
Tan, Kay Chen
Neural and Evolutionary Computing
Artificial Intelligence
Large Language Models (LLMs) possess substantial reasoning capabilities and are increasingly applied to optimization tasks, particularly in synergy with evolutionary computation. However, while recent surveys have explored specific aspects of this domain, they lack an integrative perspective that connects problem modeling with solving workflows. To address this gap, we present a systematic review of recent developments and organize them within a structured framework. First, we classify existing research into two primary stages: LLMs for optimization modeling and LLMs for optimization solving. Second, we divide the latter into three paradigms based on the role of the LLM: stand-alone optimizers, low-level components embedded within algorithms, and high-level managers for algorithm selection and generation. Third, for each category, we analyze representative methods, distill technical challenges, and examine their interplay with traditional approaches. Finally, we review interdisciplinary applications across the natural sciences, engineering, and machine learning. Based on this analysis, we highlight key limitations and point toward future directions for developing self-evolving agentic ecosystems. An up-to-date collection of related literature is maintained at https://github.com/ishmael233/LLM4OPT.
title A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving
topic Neural and Evolutionary Computing
Artificial Intelligence
url https://arxiv.org/abs/2509.08269