Traceable Text: Deepening Reading of AI-Generated Summaries with Phrase-Level Provenance Links
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913509408768000 |
|---|---|
| author | Kambhamettu, Hita Flores, Jamie Head, Andrew |
| author_facet | Kambhamettu, Hita Flores, Jamie Head, Andrew |
| contents | As AI-generated summaries proliferate, how can we help people understand the veracity of those summaries? In this short paper, we design a simple interaction primitive, traceable text, to support critical examination of generated summaries and the source texts they were derived from. In a traceable text, passages of a generated summary link to passages of the source text that informed them. A traceable text can be generated with a straightforward prompt chaining approach, and optionally adjusted by human authors depending on application. In a usability study, we examined the impact of traceable texts on reading and understanding patient medical records. Traceable text helped readers answer questions about the content of the source text more quickly and markedly improved correctness of answers in cases where there were hallucinations in the summaries. When asked to read a text of personal importance with traceable text, readers employed traceable text as an understanding aid and as an index into the source note. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_13099 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Traceable Text: Deepening Reading of AI-Generated Summaries with Phrase-Level Provenance Links Kambhamettu, Hita Flores, Jamie Head, Andrew Human-Computer Interaction As AI-generated summaries proliferate, how can we help people understand the veracity of those summaries? In this short paper, we design a simple interaction primitive, traceable text, to support critical examination of generated summaries and the source texts they were derived from. In a traceable text, passages of a generated summary link to passages of the source text that informed them. A traceable text can be generated with a straightforward prompt chaining approach, and optionally adjusted by human authors depending on application. In a usability study, we examined the impact of traceable texts on reading and understanding patient medical records. Traceable text helped readers answer questions about the content of the source text more quickly and markedly improved correctness of answers in cases where there were hallucinations in the summaries. When asked to read a text of personal importance with traceable text, readers employed traceable text as an understanding aid and as an index into the source note. |
| title | Traceable Text: Deepening Reading of AI-Generated Summaries with Phrase-Level Provenance Links |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2409.13099 |