Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2511.15830 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917093790711808 |
|---|---|
| author | Aroca-Ouellette, Stéphane Berlot-Attwell, Ian Lymperopoulos, Panagiotis Rajasekharan, Abhiramon Zhu, Tongqi Kang, Herin Suleman, Kaheer Pasupalak, Sam |
| author_facet | Aroca-Ouellette, Stéphane Berlot-Attwell, Ian Lymperopoulos, Panagiotis Rajasekharan, Abhiramon Zhu, Tongqi Kang, Herin Suleman, Kaheer Pasupalak, Sam |
| contents | Despite rapid progress in artificial intelligence, current systems struggle with the interconnected challenges that define real-world decision making. Practical domains, such as business management, require optimizing an open-ended and multi-faceted objective, actively learning environment dynamics from sparse experience, planning over long horizons in stochastic settings, and reasoning over spatial information. Yet existing human--AI benchmarks isolate subsets of these capabilities, limiting our ability to assess holistic decision-making competence. We introduce Mini Amusement Parks (MAPs), an amusement-park simulator designed to evaluate an agent's ability to model its environment, anticipate long-term consequences under uncertainty, and strategically operate a complex business. We provide human baselines and a comprehensive evaluation of state-of-the-art LLM agents, finding that humans outperform these systems by 6.5x on easy mode and 9.8x on medium mode. Our analysis reveals persistent weaknesses in long-horizon optimization, sample-efficient learning, spatial reasoning, and world modelling. By unifying these challenges within a single environment, MAPs offers a new foundation for benchmarking agents capable of adaptable decision making. Code: https://github.com/Skyfall-Research/MAPs |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_15830 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Mini Amusement Parks (MAPs): A Testbed for Modelling Business Decisions Aroca-Ouellette, Stéphane Berlot-Attwell, Ian Lymperopoulos, Panagiotis Rajasekharan, Abhiramon Zhu, Tongqi Kang, Herin Suleman, Kaheer Pasupalak, Sam Artificial Intelligence Despite rapid progress in artificial intelligence, current systems struggle with the interconnected challenges that define real-world decision making. Practical domains, such as business management, require optimizing an open-ended and multi-faceted objective, actively learning environment dynamics from sparse experience, planning over long horizons in stochastic settings, and reasoning over spatial information. Yet existing human--AI benchmarks isolate subsets of these capabilities, limiting our ability to assess holistic decision-making competence. We introduce Mini Amusement Parks (MAPs), an amusement-park simulator designed to evaluate an agent's ability to model its environment, anticipate long-term consequences under uncertainty, and strategically operate a complex business. We provide human baselines and a comprehensive evaluation of state-of-the-art LLM agents, finding that humans outperform these systems by 6.5x on easy mode and 9.8x on medium mode. Our analysis reveals persistent weaknesses in long-horizon optimization, sample-efficient learning, spatial reasoning, and world modelling. By unifying these challenges within a single environment, MAPs offers a new foundation for benchmarking agents capable of adaptable decision making. Code: https://github.com/Skyfall-Research/MAPs |
| title | Mini Amusement Parks (MAPs): A Testbed for Modelling Business Decisions |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2511.15830 |