Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.05469 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909678816985088 |
|---|---|
| author | Patino, Ceferino Billings, Tyler J. Abadi, Alireza Saleh Redder, Daniel Eck, Adam Doshi, Prashant Soh, Leen-Kiat |
| author_facet | Patino, Ceferino Billings, Tyler J. Abadi, Alireza Saleh Redder, Daniel Eck, Adam Doshi, Prashant Soh, Leen-Kiat |
| contents | We present the Methods for Open Agent Systems Evaluation Initiative (MOASEI) Competition, a multi-agent AI benchmarking event designed to evaluate decision-making under open-world conditions. Built on the free-range-zoo environment suite, MOASEI introduced dynamic, partially observable domains with agent and task openness--settings where entities may appear, disappear, or change behavior over time. The 2025 competition featured three tracks--Wildfire, Rideshare, and Cybersecurity--each highlighting distinct dimensions of openness and coordination complexity. Eleven teams from international institutions participated, with four of those teams submitting diverse solutions including graph neural networks, convolutional architectures, predictive modeling, and large language model--driven meta--optimization. Evaluation metrics centered on expected utility, robustness to perturbations, and responsiveness to environmental change. The results reveal promising strategies for generalization and adaptation in open environments, offering both empirical insight and infrastructure for future research. This report details the competition's design, findings, and contributions to the open-agent systems research community. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_05469 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Inaugural MOASEI Competition at AAMAS'2025: A Technical Report Patino, Ceferino Billings, Tyler J. Abadi, Alireza Saleh Redder, Daniel Eck, Adam Doshi, Prashant Soh, Leen-Kiat Multiagent Systems Artificial Intelligence We present the Methods for Open Agent Systems Evaluation Initiative (MOASEI) Competition, a multi-agent AI benchmarking event designed to evaluate decision-making under open-world conditions. Built on the free-range-zoo environment suite, MOASEI introduced dynamic, partially observable domains with agent and task openness--settings where entities may appear, disappear, or change behavior over time. The 2025 competition featured three tracks--Wildfire, Rideshare, and Cybersecurity--each highlighting distinct dimensions of openness and coordination complexity. Eleven teams from international institutions participated, with four of those teams submitting diverse solutions including graph neural networks, convolutional architectures, predictive modeling, and large language model--driven meta--optimization. Evaluation metrics centered on expected utility, robustness to perturbations, and responsiveness to environmental change. The results reveal promising strategies for generalization and adaptation in open environments, offering both empirical insight and infrastructure for future research. This report details the competition's design, findings, and contributions to the open-agent systems research community. |
| title | Inaugural MOASEI Competition at AAMAS'2025: A Technical Report |
| topic | Multiagent Systems Artificial Intelligence |
| url | https://arxiv.org/abs/2507.05469 |