Adaptive Reinforcement Learning Planning: Harnessing Large Language Models for Complex Information Extraction
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917762115305472 |
|---|---|
| author | Ding, Zepeng Ke, Ruiyang Huang, Wenhao Jiang, Guochao Li, Yanda Yang, Deqing Liang, Jiaqing |
| author_facet | Ding, Zepeng Ke, Ruiyang Huang, Wenhao Jiang, Guochao Li, Yanda Yang, Deqing Liang, Jiaqing |
| contents | Existing research on large language models (LLMs) shows that they can solve information extraction tasks through multi-step planning. However, their extraction behavior on complex sentences and tasks is unstable, emerging issues such as false positives and missing elements. We observe that decomposing complex extraction tasks and extracting them step by step can effectively improve LLMs' performance, and the extraction orders of entities significantly affect the final results of LLMs. This paper proposes a two-stage multi-step method for LLM-based information extraction and adopts the RL framework to execute the multi-step planning. We regard sequential extraction as a Markov decision process, build an LLM-based extraction environment, design a decision module to adaptively provide the optimal order for sequential entity extraction on different sentences, and utilize the DDQN algorithm to train the decision model. We also design the rewards and evaluation metrics suitable for the extraction results of LLMs. We conduct extensive experiments on multiple public datasets to demonstrate the effectiveness of our method in improving the information extraction capabilities of LLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_11455 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Adaptive Reinforcement Learning Planning: Harnessing Large Language Models for Complex Information Extraction Ding, Zepeng Ke, Ruiyang Huang, Wenhao Jiang, Guochao Li, Yanda Yang, Deqing Liang, Jiaqing Computation and Language Artificial Intelligence Existing research on large language models (LLMs) shows that they can solve information extraction tasks through multi-step planning. However, their extraction behavior on complex sentences and tasks is unstable, emerging issues such as false positives and missing elements. We observe that decomposing complex extraction tasks and extracting them step by step can effectively improve LLMs' performance, and the extraction orders of entities significantly affect the final results of LLMs. This paper proposes a two-stage multi-step method for LLM-based information extraction and adopts the RL framework to execute the multi-step planning. We regard sequential extraction as a Markov decision process, build an LLM-based extraction environment, design a decision module to adaptively provide the optimal order for sequential entity extraction on different sentences, and utilize the DDQN algorithm to train the decision model. We also design the rewards and evaluation metrics suitable for the extraction results of LLMs. We conduct extensive experiments on multiple public datasets to demonstrate the effectiveness of our method in improving the information extraction capabilities of LLMs. |
| title | Adaptive Reinforcement Learning Planning: Harnessing Large Language Models for Complex Information Extraction |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2406.11455 |