Do LLMs Implicitly Determine the Suitable Text Difficulty for Users?
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913239915298816 |
|---|---|
| author | Gobara, Seiji Kamigaito, Hidetaka Watanabe, Taro |
| author_facet | Gobara, Seiji Kamigaito, Hidetaka Watanabe, Taro |
| contents | Education that suits the individual learning level is necessary to improve students' understanding. The first step in achieving this purpose by using large language models (LLMs) is to adjust the textual difficulty of the response to students. This work analyzes how LLMs can implicitly adjust text difficulty between user input and its generated text. To conduct the experiments, we created a new dataset from Stack-Overflow to explore the performance of question-answering-based conversation. Experimental results on the Stack-Overflow dataset and the TSCC dataset, including multi-turn conversation show that LLMs can implicitly handle text difficulty between user input and its generated response. We also observed that some LLMs can surpass humans in handling text difficulty and the importance of instruction-tuning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_14453 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Do LLMs Implicitly Determine the Suitable Text Difficulty for Users? Gobara, Seiji Kamigaito, Hidetaka Watanabe, Taro Computation and Language Education that suits the individual learning level is necessary to improve students' understanding. The first step in achieving this purpose by using large language models (LLMs) is to adjust the textual difficulty of the response to students. This work analyzes how LLMs can implicitly adjust text difficulty between user input and its generated text. To conduct the experiments, we created a new dataset from Stack-Overflow to explore the performance of question-answering-based conversation. Experimental results on the Stack-Overflow dataset and the TSCC dataset, including multi-turn conversation show that LLMs can implicitly handle text difficulty between user input and its generated response. We also observed that some LLMs can surpass humans in handling text difficulty and the importance of instruction-tuning. |
| title | Do LLMs Implicitly Determine the Suitable Text Difficulty for Users? |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2402.14453 |