Cover Image

Benchmarking GPT-4 on Algorithmic Problems: A Systematic Evaluation of Prompting Strategies

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Petruzzellis, Flavio, Testolin, Alberto, Sperduti, Alessandro
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Neural Rewriting System to Solve Algorithmic Problems
by: Petruzzellis, Flavio, et al.
Published: (2024)

Assessing the Emergent Symbolic Reasoning Abilities of Llama Large Language Models
by: Petruzzellis, Flavio, et al.
Published: (2024)

SeaEvo: Advancing Algorithm Discovery with Strategy Space Evolution
by: Luo, Sichun, et al.
Published: (2026)

Semantic Mirror Jailbreak: Genetic Algorithm Based Jailbreak Prompts Against Open-source LLMs
by: Li, Xiaoxia, et al.
Published: (2024)

Benchmarking Randomized Optimization Algorithms on Binary, Permutation, and Combinatorial Problem Landscapes
by: Odeyemi, Jethro, et al.
Published: (2025)

EvoGPT-f: An Evolutionary GPT Framework for Benchmarking Formal Math Languages
by: Mercer, Johnathan
Published: (2024)

Visual Enumeration Remains Challenging for Multimodal Generative AI
by: Testolin, Alberto, et al.
Published: (2024)

ToxSearch: Evolving Prompts for Toxicity Search in Large Language Models
by: Shelar, Onkar, et al.
Published: (2025)

Controlled Self-Evolution for Algorithmic Code Optimization
by: Hu, Tu, et al.
Published: (2026)

Towards Explainable Evolution Strategies with Large Language Models
by: Baumann, Jill, et al.
Published: (2024)

LLM-Based Instance-Driven Heuristic Bias In the Context of a Biased Random Key Genetic Algorithm
by: Sartori, Camilo Chacón, et al.
Published: (2025)

SHS: Scorpion Hunting Strategy Swarm Algorithm
by: Singh, Abhilash, et al.
Published: (2024)

Evaluating Large Language Models with Grid-Based Game Competitions: An Extensible LLM Benchmark and Leaderboard
by: Topsakal, Oguzhan, et al.
Published: (2024)

Application of the Brain Drain Optimization Algorithm to the N-Queens Problem
by: Jolfaei, Sahar Ramezani, et al.
Published: (2025)

Bandit-Based Prompt Design Strategy Selection Improves Prompt Optimizers
by: Ashizawa, Rin, et al.
Published: (2025)

CryptoGPT: a 7B model rivaling GPT-4 in the task of analyzing and classifying real-time financial news
by: Zhang, Ying, et al.
Published: (2024)

What's the Magic Word? A Control Theory of LLM Prompting
by: Bhargava, Aman, et al.
Published: (2023)

A Tutorial on the Design, Experimentation and Application of Metaheuristic Algorithms to Real-World Optimization Problems
by: Osaba, Eneko, et al.
Published: (2024)

CAPO: Cost-Aware Prompt Optimization
by: Zehle, Tom, et al.
Published: (2025)

Evolving Benchmark Functions to Compare Evolutionary Algorithms via Genetic Programming
by: He, Yifan, et al.
Published: (2024)

Strategies for Resource Allocation of Two Competing Companies using Genetic Algorithm
by: Cheung, Wing Keung, et al.
Published: (2025)

Using 3-Objective Evolutionary Algorithms for the Dynamic Chance Constrained Knapsack Problem
by: Pathiranage, Ishara Hewa, et al.
Published: (2024)

Theoretical Analysis of Quality Diversity Algorithms for a Classical Path Planning Problem
by: Dang, Duc-Cuong, et al.
Published: (2024)

An Explainable Reconfiguration-Based Optimization Algorithm for Industrial and Reliability-Redundancy Allocation Problems
by: Chauhan, Dikshit, et al.
Published: (2025)

BEExformer: A Fast Inferencing Binarized Transformer with Early Exits
by: Ansar, Wazib, et al.
Published: (2024)

Exploring Synaptic Resonance in Large Language Models: A Novel Approach to Contextual Memory Integration
by: Applegarth, George, et al.
Published: (2025)

Hybrid Firefly-Genetic Algorithm for Single and Multi-dimensional 0-1 Knapsack Problems
by: Malanthara, Aswathi, et al.
Published: (2024)

Evolutionary Multi-Objective Optimization of Large Language Model Prompts for Balancing Sentiments
by: Baumann, Jill, et al.
Published: (2024)

NeuroTrain: Surveying Local Learning Rules for Spiking Neural Networks with an Open Benchmarking Framework
by: Caviglia, Alessio, et al.
Published: (2026)

Hidden Holes: topological aspects of language models
by: Fitz, Stephen, et al.
Published: (2024)

Agent Skill Acquisition for Large Language Models via CycleQD
by: Kuroki, So, et al.
Published: (2024)

Grounded learning for compositional vector semantics
by: Lewis, Martha
Published: (2024)

QUBE: Enhancing Automatic Heuristic Design via Quality-Uncertainty Balanced Evolution
by: Chen, Zijie, et al.
Published: (2024)

Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap
by: Wu, Xingyu, et al.
Published: (2024)

Decentralised Emergence of Robust and Adaptive Linguistic Conventions in Populations of Autonomous Agents Grounded in Continuous Worlds
by: Ekila, Jérôme Botoko, et al.
Published: (2024)

The Importance of Directional Feedback for LLM-based Optimizers
by: Nie, Allen, et al.
Published: (2024)

AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimization
by: Cemri, Mert, et al.
Published: (2026)

Neuronal Group Communication for Efficient Neural representation
by: Pei, Zhengqi, et al.
Published: (2025)

LPC-SM: Local Predictive Coding and Sparse Memory for Long-Context Language Modeling
by: Xie, Keqin
Published: (2026)

LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimization
by: Nasir, Muhammad U., et al.
Published: (2023)