Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2605.00468 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917452807405568 |
|---|---|
| author | Chan, Joey Han, Yikun Chen, Jingyuan Fang, Samuel Gryboski, Lauren D. Lee, Alexandra Tanna, Sheel Zhu, Qingqing Lu, Zhiyong Wang, Lucy Lu Guo, Yue |
| author_facet | Chan, Joey Han, Yikun Chen, Jingyuan Fang, Samuel Gryboski, Lauren D. Lee, Alexandra Tanna, Sheel Zhu, Qingqing Lu, Zhiyong Wang, Lucy Lu Guo, Yue |
| contents | Plain Language Summaries (PLS) aim to make research accessible to lay readers, but they are typically written in a one-size-fits-all style that ignores differences in readers' information needs and comprehension. In health contexts, this limitation is particularly important because misunderstanding scientific information can affect real-world decisions. Large language models (LLMs) offer new opportunities for personalizing PLS, but it remains unclear whether personalization helps, which strategies are most effective, and how to balance personalization with safety. We introduce ReLay, a dataset of 300 participant--PLS pairs from 50 lay participants in both static (expert-written) and interactive (LLM-personalized) settings. ReLay includes user characteristics, health information needs, information-seeking behavior, comprehension outcomes, interaction logs, and quality ratings. We use ReLay to evaluate five LLMs across two personalization methods. Personalization improves comprehension and perceived quality, but it also raises the risk of reinforcing user biases and introducing hallucinations, revealing a trade-off between personalization and safety. These findings highlight the need for personalization methods that are both effective and trustworthy for diverse lay audiences. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_00468 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | ReLay: Personalized LLM-Generated Plain-Language Summaries for Better Understanding, but at What Cost? Chan, Joey Han, Yikun Chen, Jingyuan Fang, Samuel Gryboski, Lauren D. Lee, Alexandra Tanna, Sheel Zhu, Qingqing Lu, Zhiyong Wang, Lucy Lu Guo, Yue Computation and Language Plain Language Summaries (PLS) aim to make research accessible to lay readers, but they are typically written in a one-size-fits-all style that ignores differences in readers' information needs and comprehension. In health contexts, this limitation is particularly important because misunderstanding scientific information can affect real-world decisions. Large language models (LLMs) offer new opportunities for personalizing PLS, but it remains unclear whether personalization helps, which strategies are most effective, and how to balance personalization with safety. We introduce ReLay, a dataset of 300 participant--PLS pairs from 50 lay participants in both static (expert-written) and interactive (LLM-personalized) settings. ReLay includes user characteristics, health information needs, information-seeking behavior, comprehension outcomes, interaction logs, and quality ratings. We use ReLay to evaluate five LLMs across two personalization methods. Personalization improves comprehension and perceived quality, but it also raises the risk of reinforcing user biases and introducing hallucinations, revealing a trade-off between personalization and safety. These findings highlight the need for personalization methods that are both effective and trustworthy for diverse lay audiences. |
| title | ReLay: Personalized LLM-Generated Plain-Language Summaries for Better Understanding, but at What Cost? |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2605.00468 |