Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ye, Yuxuan, Han, Jun, Hu, Ao, Bu, Juncheng, Chen, Yiyi, Wen, Liangjian, Mandic, Danilo, Sun, Danny Dongning, Yinghui, Xu, Xu, Zenglin
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2605.16895
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914572225478656
author Ye, Yuxuan
Han, Jun
Hu, Ao
Bu, Juncheng
Chen, Yiyi
Wen, Liangjian
Mandic, Danilo
Sun, Danny Dongning
Yinghui, Xu
Xu, Zenglin
author_facet Ye, Yuxuan
Han, Jun
Hu, Ao
Bu, Juncheng
Chen, Yiyi
Wen, Liangjian
Mandic, Danilo
Sun, Danny Dongning
Yinghui, Xu
Xu, Zenglin
contents End-to-end LLM trading agents have moved quickly from research curiosity to a small ecosystem of named systems, including FinCon, FinMem, TradingAgents, FinAgent, QuantAgent, and FLAG-Trader. Several of these report headline Sharpe ratios that would be material if read at face value on a deployment desk, and associated benchmarks such as FinBen report trading-task Sharpe statistics in the same range. The gap between architecture research and deployment claim has been crossed too freely on both sides of the academia--industry divide. We take a position on that gap: reported alpha from end-to-end LLM trading agents should not be treated as deployment evidence. Before such returns can support claims of deployable trading capability, they must survive structural validity tests for temporal integrity, real-world frictions, counterfactual robustness, predictive calibration, numerical execution, and multi-agent disaggregation. Current public evidence cannot yet distinguish robust predictive ability from temporal contamination, unmodeled frictions, short-window Sharpe uncertainty, narrative fitting, and parametric priors. The problem is not only evaluative but structural. Language confidence is not tradable probability, narrative reasoning is not numerical execution, and model priors may become undisclosed implicit factor exposures. We contribute a minimum reporting protocol suite, P1--P6, with tiered applicability by claim strength, and a conservative modular alternative that uses LLMs as auditable information interfaces upstream of independent calibration, risk, and execution modules. Code and reproduction harness: \url{https://github.com/hj1650782738/Trading}.
format Preprint
id arxiv_https___arxiv_org_abs_2605_16895
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle The Alpha Illusion: Reported Alpha from LLM Trading Agents Should Not Be Treated as Deployment Evidence
Ye, Yuxuan
Han, Jun
Hu, Ao
Bu, Juncheng
Chen, Yiyi
Wen, Liangjian
Mandic, Danilo
Sun, Danny Dongning
Yinghui, Xu
Xu, Zenglin
Computational Engineering, Finance, and Science
Artificial Intelligence
Computation and Language
End-to-end LLM trading agents have moved quickly from research curiosity to a small ecosystem of named systems, including FinCon, FinMem, TradingAgents, FinAgent, QuantAgent, and FLAG-Trader. Several of these report headline Sharpe ratios that would be material if read at face value on a deployment desk, and associated benchmarks such as FinBen report trading-task Sharpe statistics in the same range. The gap between architecture research and deployment claim has been crossed too freely on both sides of the academia--industry divide. We take a position on that gap: reported alpha from end-to-end LLM trading agents should not be treated as deployment evidence. Before such returns can support claims of deployable trading capability, they must survive structural validity tests for temporal integrity, real-world frictions, counterfactual robustness, predictive calibration, numerical execution, and multi-agent disaggregation. Current public evidence cannot yet distinguish robust predictive ability from temporal contamination, unmodeled frictions, short-window Sharpe uncertainty, narrative fitting, and parametric priors. The problem is not only evaluative but structural. Language confidence is not tradable probability, narrative reasoning is not numerical execution, and model priors may become undisclosed implicit factor exposures. We contribute a minimum reporting protocol suite, P1--P6, with tiered applicability by claim strength, and a conservative modular alternative that uses LLMs as auditable information interfaces upstream of independent calibration, risk, and execution modules. Code and reproduction harness: \url{https://github.com/hj1650782738/Trading}.
title The Alpha Illusion: Reported Alpha from LLM Trading Agents Should Not Be Treated as Deployment Evidence
topic Computational Engineering, Finance, and Science
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2605.16895