GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaboration

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Li, Xin, Chu, Qizhi, Chen, Yubin, Liu, Yang, Liu, Yaoqi, Yu, Zekai, Chen, Weize, Qian, Chen, Shi, Chuan, Yang, Cheng
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918182842793984
author Li, Xin
Chu, Qizhi
Chen, Yubin
Liu, Yang
Liu, Yaoqi
Yu, Zekai
Chen, Weize
Qian, Chen
Shi, Chuan
Yang, Cheng
author_facet Li, Xin
Chu, Qizhi
Chen, Yubin
Liu, Yang
Liu, Yaoqi
Yu, Zekai
Chen, Weize
Qian, Chen
Shi, Chuan
Yang, Cheng
contents Graphs are widely used for modeling relational data in real-world scenarios, such as social networks and urban computing. Existing LLM-based graph analysis approaches either integrate graph neural networks (GNNs) for specific machine learning tasks, limiting their transferability, or rely solely on LLMs' internal reasoning ability, resulting in suboptimal performance. To address these limitations, we take advantage of recent advances in LLM-based agents, which have shown capabilities of utilizing external knowledge or tools for problem solving. By simulating human problem-solving strategies such as analogy and collaboration, we propose a multi-agent system based on LLMs named GraphTeam, for graph analysis. GraphTeam consists of five LLM-based agents from three modules, and the agents with different specialities can collaborate with each other to address complex problems. Specifically, (1) input-output normalization module: the question agent extracts and refines four key arguments from the original question, facilitating the problem understanding, and the answer agent organizes the results to meet the output requirement; (2) external knowledge retrieval module: we first build a knowledge base consisting of relevant documentation and experience information, and then the search agent retrieves the most relevant entries for each question. (3) problem-solving module: given the retrieved information from search agent, the coding agent uses established algorithms via programming to generate solutions, and in case the coding agent does not work, the reasoning agent will directly compute the results without programming. Extensive experiments on six graph analysis benchmarks demonstrate that GraphTeam achieves state-of-the-art performance with an average 25.85% improvement over the best baseline in terms of accuracy. The code and data are available at https://github.com/BUPT-GAMMA/GraphTeam.
format Preprint
id arxiv_https___arxiv_org_abs_2410_18032
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaboration
Li, Xin
Chu, Qizhi
Chen, Yubin
Liu, Yang
Liu, Yaoqi
Yu, Zekai
Chen, Weize
Qian, Chen
Shi, Chuan
Yang, Cheng
Artificial Intelligence
Computation and Language
Multiagent Systems
Graphs are widely used for modeling relational data in real-world scenarios, such as social networks and urban computing. Existing LLM-based graph analysis approaches either integrate graph neural networks (GNNs) for specific machine learning tasks, limiting their transferability, or rely solely on LLMs' internal reasoning ability, resulting in suboptimal performance. To address these limitations, we take advantage of recent advances in LLM-based agents, which have shown capabilities of utilizing external knowledge or tools for problem solving. By simulating human problem-solving strategies such as analogy and collaboration, we propose a multi-agent system based on LLMs named GraphTeam, for graph analysis. GraphTeam consists of five LLM-based agents from three modules, and the agents with different specialities can collaborate with each other to address complex problems. Specifically, (1) input-output normalization module: the question agent extracts and refines four key arguments from the original question, facilitating the problem understanding, and the answer agent organizes the results to meet the output requirement; (2) external knowledge retrieval module: we first build a knowledge base consisting of relevant documentation and experience information, and then the search agent retrieves the most relevant entries for each question. (3) problem-solving module: given the retrieved information from search agent, the coding agent uses established algorithms via programming to generate solutions, and in case the coding agent does not work, the reasoning agent will directly compute the results without programming. Extensive experiments on six graph analysis benchmarks demonstrate that GraphTeam achieves state-of-the-art performance with an average 25.85% improvement over the best baseline in terms of accuracy. The code and data are available at https://github.com/BUPT-GAMMA/GraphTeam.
title GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaboration
topic Artificial Intelligence
Computation and Language
Multiagent Systems
url https://arxiv.org/abs/2410.18032