Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917608117239808 |
|---|---|
| author | Lin, Susan Warner, Jeremy Zamfirescu-Pereira, J. D. Lee, Matthew G. Jain, Sauhard Huang, Michael Xuelin Lertvittayakumjorn, Piyawat Cai, Shanqing Zhai, Shumin Hartmann, Björn Liu, Can |
| author_facet | Lin, Susan Warner, Jeremy Zamfirescu-Pereira, J. D. Lee, Matthew G. Jain, Sauhard Huang, Michael Xuelin Lertvittayakumjorn, Piyawat Cai, Shanqing Zhai, Shumin Hartmann, Björn Liu, Can |
| contents | Dictation enables efficient text input on mobile devices. However, writing with speech can produce disfluent, wordy, and incoherent text and thus requires heavy post-processing. This paper presents Rambler, an LLM-powered graphical user interface that supports gist-level manipulation of dictated text with two main sets of functions: gist extraction and macro revision. Gist extraction generates keywords and summaries as anchors to support the review and interaction with spoken text. LLM-assisted macro revisions allow users to respeak, split, merge and transform dictated text without specifying precise editing locations. Together they pave the way for interactive dictation and revision that help close gaps between spontaneous spoken words and well-structured writing. In a comparative study with 12 participants performing verbal composition tasks, Rambler outperformed the baseline of a speech-to-text editor + ChatGPT, as it better facilitates iterative revisions with enhanced user control over the content while supporting surprisingly diverse user strategies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_10838 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation Lin, Susan Warner, Jeremy Zamfirescu-Pereira, J. D. Lee, Matthew G. Jain, Sauhard Huang, Michael Xuelin Lertvittayakumjorn, Piyawat Cai, Shanqing Zhai, Shumin Hartmann, Björn Liu, Can Human-Computer Interaction Dictation enables efficient text input on mobile devices. However, writing with speech can produce disfluent, wordy, and incoherent text and thus requires heavy post-processing. This paper presents Rambler, an LLM-powered graphical user interface that supports gist-level manipulation of dictated text with two main sets of functions: gist extraction and macro revision. Gist extraction generates keywords and summaries as anchors to support the review and interaction with spoken text. LLM-assisted macro revisions allow users to respeak, split, merge and transform dictated text without specifying precise editing locations. Together they pave the way for interactive dictation and revision that help close gaps between spontaneous spoken words and well-structured writing. In a comparative study with 12 participants performing verbal composition tasks, Rambler outperformed the baseline of a speech-to-text editor + ChatGPT, as it better facilitates iterative revisions with enhanced user control over the content while supporting surprisingly diverse user strategies. |
| title | Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2401.10838 |