A Compressive Memory-based Retrieval Approach for Event Argument Extraction
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913500191784960 |
|---|---|
| author | Liu, Wanlong Zhang, Enqi Zhou, Li Zeng, Dingyi Cheng, Shaohuan Zhang, Chen Zhang, Malu Chen, Wenyu |
| author_facet | Liu, Wanlong Zhang, Enqi Zhou, Li Zeng, Dingyi Cheng, Shaohuan Zhang, Chen Zhang, Malu Chen, Wenyu |
| contents | Recent works have demonstrated the effectiveness of retrieval augmentation in the Event Argument Extraction (EAE) task. However, existing retrieval-based EAE methods have two main limitations: (1) input length constraints and (2) the gap between the retriever and the inference model. These issues limit the diversity and quality of the retrieved information. In this paper, we propose a Compressive Memory-based Retrieval (CMR) mechanism for EAE, which addresses the two limitations mentioned above. Our compressive memory, designed as a dynamic matrix that effectively caches retrieved information and supports continuous updates, overcomes the limitations of the input length. Additionally, after pre-loading all candidate demonstrations into the compressive memory, the model further retrieves and filters relevant information from memory based on the input query, bridging the gap between the retriever and the inference model. Extensive experiments show that our method achieves new state-of-the-art performance on three public datasets (RAMS, WikiEvents, ACE05), significantly outperforming existing retrieval-based EAE methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_09322 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Compressive Memory-based Retrieval Approach for Event Argument Extraction Liu, Wanlong Zhang, Enqi Zhou, Li Zeng, Dingyi Cheng, Shaohuan Zhang, Chen Zhang, Malu Chen, Wenyu Computation and Language Recent works have demonstrated the effectiveness of retrieval augmentation in the Event Argument Extraction (EAE) task. However, existing retrieval-based EAE methods have two main limitations: (1) input length constraints and (2) the gap between the retriever and the inference model. These issues limit the diversity and quality of the retrieved information. In this paper, we propose a Compressive Memory-based Retrieval (CMR) mechanism for EAE, which addresses the two limitations mentioned above. Our compressive memory, designed as a dynamic matrix that effectively caches retrieved information and supports continuous updates, overcomes the limitations of the input length. Additionally, after pre-loading all candidate demonstrations into the compressive memory, the model further retrieves and filters relevant information from memory based on the input query, bridging the gap between the retriever and the inference model. Extensive experiments show that our method achieves new state-of-the-art performance on three public datasets (RAMS, WikiEvents, ACE05), significantly outperforming existing retrieval-based EAE methods. |
| title | A Compressive Memory-based Retrieval Approach for Event Argument Extraction |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2409.09322 |