On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910318902378496 |
|---|---|
| author | Wijesiriwardene, Thilini Wickramarachchi, Ruwan Reganti, Aishwarya Naresh Jain, Vinija Chadha, Aman Sheth, Amit Das, Amitava |
| author_facet | Wijesiriwardene, Thilini Wickramarachchi, Ruwan Reganti, Aishwarya Naresh Jain, Vinija Chadha, Aman Sheth, Amit Das, Amitava |
| contents | The ability of Large Language Models (LLMs) to encode syntactic and semantic structures of language is well examined in NLP. Additionally, analogy identification, in the form of word analogies are extensively studied in the last decade of language modeling literature. In this work we specifically look at how LLMs' abilities to capture sentence analogies (sentences that convey analogous meaning to each other) vary with LLMs' abilities to encode syntactic and semantic structures of sentences. Through our analysis, we find that LLMs' ability to identify sentence analogies is positively correlated with their ability to encode syntactic and semantic structures of sentences. Specifically, we find that the LLMs which capture syntactic structures better, also have higher abilities in identifying sentence analogies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_07818 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language Models Wijesiriwardene, Thilini Wickramarachchi, Ruwan Reganti, Aishwarya Naresh Jain, Vinija Chadha, Aman Sheth, Amit Das, Amitava Computation and Language Artificial Intelligence The ability of Large Language Models (LLMs) to encode syntactic and semantic structures of language is well examined in NLP. Additionally, analogy identification, in the form of word analogies are extensively studied in the last decade of language modeling literature. In this work we specifically look at how LLMs' abilities to capture sentence analogies (sentences that convey analogous meaning to each other) vary with LLMs' abilities to encode syntactic and semantic structures of sentences. Through our analysis, we find that LLMs' ability to identify sentence analogies is positively correlated with their ability to encode syntactic and semantic structures of sentences. Specifically, we find that the LLMs which capture syntactic structures better, also have higher abilities in identifying sentence analogies. |
| title | On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language Models |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2310.07818 |