Writer-Defined AI Personas for On-Demand Feedback Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Benharrak, Karim, Zindulka, Tim, Lehmann, Florian, Heuer, Hendrik, Buschek, Daniel
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913237864284160
author Benharrak, Karim
Zindulka, Tim
Lehmann, Florian
Heuer, Hendrik
Buschek, Daniel
author_facet Benharrak, Karim
Zindulka, Tim
Lehmann, Florian
Heuer, Hendrik
Buschek, Daniel
contents Compelling writing is tailored to its audience. This is challenging, as writers may struggle to empathize with readers, get feedback in time, or gain access to the target group. We propose a concept that generates on-demand feedback, based on writer-defined AI personas of any target audience. We explore this concept with a prototype (using GPT-3.5) in two user studies (N=5 and N=11): Writers appreciated the concept and strategically used personas for getting different perspectives. The feedback was seen as helpful and inspired revisions of text and personas, although it was often verbose and unspecific. We discuss the impact of on-demand feedback, the limited representativity of contemporary AI systems, and further ideas for defining AI personas. This work contributes to the vision of supporting writers with AI by expanding the socio-technical perspective in AI tool design: To empower creators, we also need to keep in mind their relationship to an audience.
format Preprint
id arxiv_https___arxiv_org_abs_2309_10433
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Writer-Defined AI Personas for On-Demand Feedback Generation
Benharrak, Karim
Zindulka, Tim
Lehmann, Florian
Heuer, Hendrik
Buschek, Daniel
Human-Computer Interaction
Computation and Language
H.5.2; I.2.7
Compelling writing is tailored to its audience. This is challenging, as writers may struggle to empathize with readers, get feedback in time, or gain access to the target group. We propose a concept that generates on-demand feedback, based on writer-defined AI personas of any target audience. We explore this concept with a prototype (using GPT-3.5) in two user studies (N=5 and N=11): Writers appreciated the concept and strategically used personas for getting different perspectives. The feedback was seen as helpful and inspired revisions of text and personas, although it was often verbose and unspecific. We discuss the impact of on-demand feedback, the limited representativity of contemporary AI systems, and further ideas for defining AI personas. This work contributes to the vision of supporting writers with AI by expanding the socio-technical perspective in AI tool design: To empower creators, we also need to keep in mind their relationship to an audience.
title Writer-Defined AI Personas for On-Demand Feedback Generation
topic Human-Computer Interaction
Computation and Language
H.5.2; I.2.7
url https://arxiv.org/abs/2309.10433