OpenHospital: A Thing-in-itself Arena for Evolving and Benchmarking LLM-based Collective Intelligence
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913175440457728 |
|---|---|
| author | Liu, Peigen Ding, Rui Mao, Yuren Jiang, Ziyan Ye, Yuxiang Gao, Yunjun Zhang, Ying Sun, Renjie Lai, Longbin Qian, Zhengping |
| author_facet | Liu, Peigen Ding, Rui Mao, Yuren Jiang, Ziyan Ye, Yuxiang Gao, Yunjun Zhang, Ying Sun, Renjie Lai, Longbin Qian, Zhengping |
| contents | Large Language Model (LLM)-based Collective Intelligence (CI) presents a promising approach to overcoming the data wall and continuously boosting the capabilities of LLM agents. However, there is currently no dedicated arena for evolving and benchmarking LLM-based CI. To address this gap, we introduce OpenHospital, an interactive arena where physician agents can evolve CI through interactions with patient agents. This arena employs a data-in-agent-self paradigm that rapidly enhances agent capabilities and provides robust evaluation metrics for benchmarking both medical proficiency and system efficiency. Experiments demonstrate the effectiveness of OpenHospital in both fostering and quantifying CI. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_14771 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | OpenHospital: A Thing-in-itself Arena for Evolving and Benchmarking LLM-based Collective Intelligence Liu, Peigen Ding, Rui Mao, Yuren Jiang, Ziyan Ye, Yuxiang Gao, Yunjun Zhang, Ying Sun, Renjie Lai, Longbin Qian, Zhengping Artificial Intelligence Large Language Model (LLM)-based Collective Intelligence (CI) presents a promising approach to overcoming the data wall and continuously boosting the capabilities of LLM agents. However, there is currently no dedicated arena for evolving and benchmarking LLM-based CI. To address this gap, we introduce OpenHospital, an interactive arena where physician agents can evolve CI through interactions with patient agents. This arena employs a data-in-agent-self paradigm that rapidly enhances agent capabilities and provides robust evaluation metrics for benchmarking both medical proficiency and system efficiency. Experiments demonstrate the effectiveness of OpenHospital in both fostering and quantifying CI. |
| title | OpenHospital: A Thing-in-itself Arena for Evolving and Benchmarking LLM-based Collective Intelligence |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2603.14771 |