SR-LLM: Rethinking the Structured Representation in Large Language Model
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913700362846208 |
|---|---|
| author | Zhang, Jiahuan Wang, Tianheng Wu, Hanqing Huang, Ziyi Wu, Yulong Chen, Dongbai Song, Linfeng Zhang, Yue Rao, Guozheng Yu, Kaicheng |
| author_facet | Zhang, Jiahuan Wang, Tianheng Wu, Hanqing Huang, Ziyi Wu, Yulong Chen, Dongbai Song, Linfeng Zhang, Yue Rao, Guozheng Yu, Kaicheng |
| contents | Structured representations, exemplified by Abstract Meaning Representation (AMR), have long been pivotal in computational linguistics. However, their role remains ambiguous in the Large Language Models (LLMs) era. Initial attempts to integrate structured representation into LLMs via a zero-shot setting yielded inferior performance. We hypothesize that such a decline stems from the structure information being passed into LLMs in a code format unfamiliar to LLMs' training corpora. Consequently, we propose SR-LLM, an innovative framework with two settings to explore a superior way of integrating structured representation with LLMs from training-free and training-dependent perspectives. The former integrates structural information through natural language descriptions in LLM prompts, whereas its counterpart augments the model's inference capability through fine-tuning on linguistically described structured representations. Performance improvements were observed in widely downstream datasets, with particularly notable gains of 3.17% and 12.38% in PAWS. To the best of our knowledge, this work represents the pioneering demonstration that leveraging structural representations can substantially enhance LLMs' inference capability. We hope that our work sheds light and encourages future research to enhance the reasoning and interoperability of LLMs by structure data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_14352 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | SR-LLM: Rethinking the Structured Representation in Large Language Model Zhang, Jiahuan Wang, Tianheng Wu, Hanqing Huang, Ziyi Wu, Yulong Chen, Dongbai Song, Linfeng Zhang, Yue Rao, Guozheng Yu, Kaicheng Computation and Language Structured representations, exemplified by Abstract Meaning Representation (AMR), have long been pivotal in computational linguistics. However, their role remains ambiguous in the Large Language Models (LLMs) era. Initial attempts to integrate structured representation into LLMs via a zero-shot setting yielded inferior performance. We hypothesize that such a decline stems from the structure information being passed into LLMs in a code format unfamiliar to LLMs' training corpora. Consequently, we propose SR-LLM, an innovative framework with two settings to explore a superior way of integrating structured representation with LLMs from training-free and training-dependent perspectives. The former integrates structural information through natural language descriptions in LLM prompts, whereas its counterpart augments the model's inference capability through fine-tuning on linguistically described structured representations. Performance improvements were observed in widely downstream datasets, with particularly notable gains of 3.17% and 12.38% in PAWS. To the best of our knowledge, this work represents the pioneering demonstration that leveraging structural representations can substantially enhance LLMs' inference capability. We hope that our work sheds light and encourages future research to enhance the reasoning and interoperability of LLMs by structure data. |
| title | SR-LLM: Rethinking the Structured Representation in Large Language Model |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2502.14352 |