"It makes you think": Provocations Help Restore Critical Thinking to AI-Assisted Knowledge Work
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912208480370688 |
|---|---|
| author | Drosos, Ian Sarkar, Advait Xiaotong Xu Toronto, Neil |
| author_facet | Drosos, Ian Sarkar, Advait Xiaotong Xu Toronto, Neil |
| contents | Recent research suggests that the use of Generative AI tools may result in diminished critical thinking during knowledge work. We study the effect on knowledge work of provocations: brief textual prompts that offer critiques for and propose alternatives to AI suggestions. We conduct a between-subjects study (n=24) in which participants completed AI-assisted shortlisting tasks with and without provocations. We find that provocations can induce critical and metacognitive thinking. We derive five dimensions that impact the user experience of provocations: task urgency, task importance, user expertise, provocation actionability, and user responsibility. We connect our findings to related work on design frictions, microboundaries, and distributed cognition. We draw design implications for critical thinking interventions in AI-assisted knowledge work. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_17247 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | "It makes you think": Provocations Help Restore Critical Thinking to AI-Assisted Knowledge Work Drosos, Ian Sarkar, Advait Xiaotong Xu Toronto, Neil Human-Computer Interaction Recent research suggests that the use of Generative AI tools may result in diminished critical thinking during knowledge work. We study the effect on knowledge work of provocations: brief textual prompts that offer critiques for and propose alternatives to AI suggestions. We conduct a between-subjects study (n=24) in which participants completed AI-assisted shortlisting tasks with and without provocations. We find that provocations can induce critical and metacognitive thinking. We derive five dimensions that impact the user experience of provocations: task urgency, task importance, user expertise, provocation actionability, and user responsibility. We connect our findings to related work on design frictions, microboundaries, and distributed cognition. We draw design implications for critical thinking interventions in AI-assisted knowledge work. |
| title | "It makes you think": Provocations Help Restore Critical Thinking to AI-Assisted Knowledge Work |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2501.17247 |