Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.02745 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915370625925120 |
|---|---|
| author | Ashktorab, Zahra Buccella, Alessandra D'Cruz, Jason Fowler, Zoe Gill, Andrew Leung, Kei Yan Magnus, P. D. Richards, John Varshney, Kush R. |
| author_facet | Ashktorab, Zahra Buccella, Alessandra D'Cruz, Jason Fowler, Zoe Gill, Andrew Leung, Kei Yan Magnus, P. D. Richards, John Varshney, Kush R. |
| contents | As chatbots driven by large language models (LLMs) are increasingly deployed in everyday contexts, their ability to recover from errors through effective apologies is critical to maintaining user trust and satisfaction. In a preregistered study with Prolific workers (N=162), we examine user preferences for three types of apologies (rote, explanatory, and empathic) issued in response to three categories of common LLM mistakes (bias, unfounded fabrication, and factual errors). We designed a pairwise experiment in which participants evaluated chatbot responses consisting of an initial error, a subsequent apology, and a resolution. Explanatory apologies were generally preferred, but this varied by context and user. In the bias scenario, empathic apologies were favored for acknowledging emotional impact, while hallucinations, though seen as serious, elicited no clear preference, reflecting user uncertainty. Our findings show the complexity of effective apology in AI systems. We discuss key insights such as personalization and calibration that future systems must navigate to meaningfully repair trust. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_02745 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Who's Sorry Now: User Preferences Among Rote, Empathic, and Explanatory Apologies from LLM Chatbots Ashktorab, Zahra Buccella, Alessandra D'Cruz, Jason Fowler, Zoe Gill, Andrew Leung, Kei Yan Magnus, P. D. Richards, John Varshney, Kush R. Human-Computer Interaction As chatbots driven by large language models (LLMs) are increasingly deployed in everyday contexts, their ability to recover from errors through effective apologies is critical to maintaining user trust and satisfaction. In a preregistered study with Prolific workers (N=162), we examine user preferences for three types of apologies (rote, explanatory, and empathic) issued in response to three categories of common LLM mistakes (bias, unfounded fabrication, and factual errors). We designed a pairwise experiment in which participants evaluated chatbot responses consisting of an initial error, a subsequent apology, and a resolution. Explanatory apologies were generally preferred, but this varied by context and user. In the bias scenario, empathic apologies were favored for acknowledging emotional impact, while hallucinations, though seen as serious, elicited no clear preference, reflecting user uncertainty. Our findings show the complexity of effective apology in AI systems. We discuss key insights such as personalization and calibration that future systems must navigate to meaningfully repair trust. |
| title | Who's Sorry Now: User Preferences Among Rote, Empathic, and Explanatory Apologies from LLM Chatbots |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2507.02745 |