Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2604.17897 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915945014886400 |
|---|---|
| author | Zhan, Hongyu Wang, Qixin Tan, Yusen Yu, Haitao Zhou, Jingbo Chen, Shuai Li, Jia Tan, Xiao Xia, Jun |
| author_facet | Zhan, Hongyu Wang, Qixin Tan, Yusen Yu, Haitao Zhou, Jingbo Chen, Shuai Li, Jia Tan, Xiao Xia, Jun |
| contents | The advent of Large Language Models (LLMs) has fundamentally reshaped the way we interact with graphs, giving rise to a new paradigm called GraphLLM. As revealed in recent studies, graph learning can benefit from LLMs. However, we observe limited benefits when we directly utilize LLMs to make predictions for graph-related tasks within GraphLLM paradigm, which even yields suboptimal results compared to conventional GNN-based approaches. Through in-depth analysis, we find this failure can be attributed to LLMs' limited capability for processing graph data and their tendency to overlook graph information. To address this issue, we propose LoReC (Look, Remember, and Contrast), a novel plug-and-play method for GraphLLM paradigm, which enhances LLM's understanding of graph data through three stages: (1) Look: redistributing attention to graph; (2) Remember: re-injecting graph information into the Feed-Forward Network (FFN); (3) Contrast: rectifying the vanilla logits produced in the decoding process. Extensive experiments demonstrate that LoReC brings notable improvements over current GraphLLM methods and outperforms GNN-based approaches across diverse datasets. The implementation is available at https://github.com/Git-King-Zhan/LoReC. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_17897 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | LoReC: Rethinking Large Language Models for Graph Data Analysis Zhan, Hongyu Wang, Qixin Tan, Yusen Yu, Haitao Zhou, Jingbo Chen, Shuai Li, Jia Tan, Xiao Xia, Jun Machine Learning Artificial Intelligence The advent of Large Language Models (LLMs) has fundamentally reshaped the way we interact with graphs, giving rise to a new paradigm called GraphLLM. As revealed in recent studies, graph learning can benefit from LLMs. However, we observe limited benefits when we directly utilize LLMs to make predictions for graph-related tasks within GraphLLM paradigm, which even yields suboptimal results compared to conventional GNN-based approaches. Through in-depth analysis, we find this failure can be attributed to LLMs' limited capability for processing graph data and their tendency to overlook graph information. To address this issue, we propose LoReC (Look, Remember, and Contrast), a novel plug-and-play method for GraphLLM paradigm, which enhances LLM's understanding of graph data through three stages: (1) Look: redistributing attention to graph; (2) Remember: re-injecting graph information into the Feed-Forward Network (FFN); (3) Contrast: rectifying the vanilla logits produced in the decoding process. Extensive experiments demonstrate that LoReC brings notable improvements over current GraphLLM methods and outperforms GNN-based approaches across diverse datasets. The implementation is available at https://github.com/Git-King-Zhan/LoReC. |
| title | LoReC: Rethinking Large Language Models for Graph Data Analysis |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2604.17897 |