Manalyzer: End-to-end Automated Meta-analysis with Multi-agent System
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915741872160768 |
|---|---|
| author | Xu, Wanghan Zhang, Wenlong Ling, Fenghua Fei, Ben Hu, Yusong Ma, Runmin Zhang, Bo Ren, Fangxuan Lin, Jintai Ouyang, Wanli Bai, Lei |
| author_facet | Xu, Wanghan Zhang, Wenlong Ling, Fenghua Fei, Ben Hu, Yusong Ma, Runmin Zhang, Bo Ren, Fangxuan Lin, Jintai Ouyang, Wanli Bai, Lei |
| contents | Meta-analysis is a systematic research methodology that synthesizes data from multiple existing studies to derive comprehensive conclusions. This approach not only mitigates limitations inherent in individual studies but also facilitates novel discoveries through integrated data analysis. Traditional meta-analysis involves a complex multi-stage pipeline including literature retrieval, paper screening, and data extraction, which demands substantial human effort and time. However, while LLM-based methods can accelerate certain stages, they still face significant challenges, such as hallucinations in paper screening and data extraction. In this paper, we propose a multi-agent system, Manalyzer, which achieves end-to-end automated meta-analysis through tool calls. The hybrid review, hierarchical extraction, self-proving, and feedback checking strategies implemented in Manalyzer significantly alleviate these two hallucinations. To comprehensively evaluate the performance of meta-analysis, we construct a new benchmark comprising 729 papers across 3 domains, encompassing text, image, and table modalities, with over 10,000 data points. Extensive experiments demonstrate that Manalyzer achieves significant performance improvements over the LLM baseline in multi meta-analysis tasks. Project page: https://black-yt.github.io/meta-analysis-page/ . |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_20310 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Manalyzer: End-to-end Automated Meta-analysis with Multi-agent System Xu, Wanghan Zhang, Wenlong Ling, Fenghua Fei, Ben Hu, Yusong Ma, Runmin Zhang, Bo Ren, Fangxuan Lin, Jintai Ouyang, Wanli Bai, Lei Artificial Intelligence Multiagent Systems Meta-analysis is a systematic research methodology that synthesizes data from multiple existing studies to derive comprehensive conclusions. This approach not only mitigates limitations inherent in individual studies but also facilitates novel discoveries through integrated data analysis. Traditional meta-analysis involves a complex multi-stage pipeline including literature retrieval, paper screening, and data extraction, which demands substantial human effort and time. However, while LLM-based methods can accelerate certain stages, they still face significant challenges, such as hallucinations in paper screening and data extraction. In this paper, we propose a multi-agent system, Manalyzer, which achieves end-to-end automated meta-analysis through tool calls. The hybrid review, hierarchical extraction, self-proving, and feedback checking strategies implemented in Manalyzer significantly alleviate these two hallucinations. To comprehensively evaluate the performance of meta-analysis, we construct a new benchmark comprising 729 papers across 3 domains, encompassing text, image, and table modalities, with over 10,000 data points. Extensive experiments demonstrate that Manalyzer achieves significant performance improvements over the LLM baseline in multi meta-analysis tasks. Project page: https://black-yt.github.io/meta-analysis-page/ . |
| title | Manalyzer: End-to-end Automated Meta-analysis with Multi-agent System |
| topic | Artificial Intelligence Multiagent Systems |
| url | https://arxiv.org/abs/2505.20310 |