Enhancing Coreference Resolution with Pretrained Language Models: Bridging the Gap Between Syntax and Semantics
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909571508862976 |
|---|---|
| author | Liu, Xingzu deng, Songhang Wang, Mingbang Dong, Zhang Dai, Le Li, Jiyuan Nong, Ruilin |
| author_facet | Liu, Xingzu deng, Songhang Wang, Mingbang Dong, Zhang Dai, Le Li, Jiyuan Nong, Ruilin |
| contents | Large language models have made significant advancements in various natural language processing tasks, including coreference resolution. However, traditional methods often fall short in effectively distinguishing referential relationships due to a lack of integration between syntactic and semantic information. This study introduces an innovative framework aimed at enhancing coreference resolution by utilizing pretrained language models. Our approach combines syntax parsing with semantic role labeling to accurately capture finer distinctions in referential relationships. By employing state-of-the-art pretrained models to gather contextual embeddings and applying an attention mechanism for fine-tuning, we improve the performance of coreference tasks. Experimental results across diverse datasets show that our method surpasses conventional coreference resolution systems, achieving notable accuracy in disambiguating references. This development not only improves coreference resolution outcomes but also positively impacts other natural language processing tasks that depend on precise referential understanding. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_05855 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Enhancing Coreference Resolution with Pretrained Language Models: Bridging the Gap Between Syntax and Semantics Liu, Xingzu deng, Songhang Wang, Mingbang Dong, Zhang Dai, Le Li, Jiyuan Nong, Ruilin Computation and Language Artificial Intelligence Large language models have made significant advancements in various natural language processing tasks, including coreference resolution. However, traditional methods often fall short in effectively distinguishing referential relationships due to a lack of integration between syntactic and semantic information. This study introduces an innovative framework aimed at enhancing coreference resolution by utilizing pretrained language models. Our approach combines syntax parsing with semantic role labeling to accurately capture finer distinctions in referential relationships. By employing state-of-the-art pretrained models to gather contextual embeddings and applying an attention mechanism for fine-tuning, we improve the performance of coreference tasks. Experimental results across diverse datasets show that our method surpasses conventional coreference resolution systems, achieving notable accuracy in disambiguating references. This development not only improves coreference resolution outcomes but also positively impacts other natural language processing tasks that depend on precise referential understanding. |
| title | Enhancing Coreference Resolution with Pretrained Language Models: Bridging the Gap Between Syntax and Semantics |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2504.05855 |