StockSim: A Dual-Mode Order-Level Simulator for Evaluating Multi-Agent LLMs in Financial Markets

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Papadakis, Charidimos, Filandrianos, Giorgos, Dimitriou, Angeliki, Lymperaiou, Maria, Thomas, Konstantinos, Stamou, Giorgos
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908447802392576
author Papadakis, Charidimos
Filandrianos, Giorgos
Dimitriou, Angeliki
Lymperaiou, Maria
Thomas, Konstantinos
Stamou, Giorgos
author_facet Papadakis, Charidimos
Filandrianos, Giorgos
Dimitriou, Angeliki
Lymperaiou, Maria
Thomas, Konstantinos
Stamou, Giorgos
contents We present StockSim, an open-source simulation platform for systematic evaluation of large language models (LLMs) in realistic financial decision-making scenarios. Unlike previous toolkits that offer limited scope, StockSim delivers a comprehensive system that fully models market dynamics and supports diverse simulation modes of varying granularity. It incorporates critical real-world factors, such as latency, slippage, and order-book microstructure, that were previously neglected, enabling more faithful and insightful assessment of LLM-based trading agents. An extensible, role-based agent framework supports heterogeneous trading strategies and multi-agent coordination, making StockSim a uniquely capable testbed for NLP research on reasoning under uncertainty and sequential decision-making. We open-source all our code at https: //github.com/harrypapa2002/StockSim.
format Preprint
id arxiv_https___arxiv_org_abs_2507_09255
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle StockSim: A Dual-Mode Order-Level Simulator for Evaluating Multi-Agent LLMs in Financial Markets
Papadakis, Charidimos
Filandrianos, Giorgos
Dimitriou, Angeliki
Lymperaiou, Maria
Thomas, Konstantinos
Stamou, Giorgos
Computational Engineering, Finance, and Science
Multiagent Systems
We present StockSim, an open-source simulation platform for systematic evaluation of large language models (LLMs) in realistic financial decision-making scenarios. Unlike previous toolkits that offer limited scope, StockSim delivers a comprehensive system that fully models market dynamics and supports diverse simulation modes of varying granularity. It incorporates critical real-world factors, such as latency, slippage, and order-book microstructure, that were previously neglected, enabling more faithful and insightful assessment of LLM-based trading agents. An extensible, role-based agent framework supports heterogeneous trading strategies and multi-agent coordination, making StockSim a uniquely capable testbed for NLP research on reasoning under uncertainty and sequential decision-making. We open-source all our code at https: //github.com/harrypapa2002/StockSim.
title StockSim: A Dual-Mode Order-Level Simulator for Evaluating Multi-Agent LLMs in Financial Markets
topic Computational Engineering, Finance, and Science
Multiagent Systems
url https://arxiv.org/abs/2507.09255