Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2603.27318 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911550437064704 |
|---|---|
| author | Fischer, Simon WS Schraffenberger, Hanna Thill, Serge Haselager, Pim |
| author_facet | Fischer, Simon WS Schraffenberger, Hanna Thill, Serge Haselager, Pim |
| contents | Many generative AI systems as well as decision-support systems (DSSs) provide operators with predictions or recommendations. Various studies show, however, that people can mistakenly adopt the erroneous results presented by those systems. Hence, it is crucial to promote critical thinking and reflection during interaction. One approach we are focusing on involves encouraging reflection during machine-assisted decision-making by presenting decision-makers with data-driven questions. In this short paper, we provide a brief overview of our work in that regard, namely: 1) the development of a question taxonomy, 2) the development of a prototype in the medical domain and the feedback received from clinicians, 3) a method for generating questions using a large language model, and 4) a proposed scale for measuring cognitive engagement in human-AI decision-making. In doing so, we contribute to the discussion about the design, development, and evaluation of tools for thought, i.e., AI systems that provoke critical thinking and enable novel ways of sense-making. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_27318 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Supporting Reflection and Forward-Looking Reasoning With Data-Driven Questions Fischer, Simon WS Schraffenberger, Hanna Thill, Serge Haselager, Pim Human-Computer Interaction Many generative AI systems as well as decision-support systems (DSSs) provide operators with predictions or recommendations. Various studies show, however, that people can mistakenly adopt the erroneous results presented by those systems. Hence, it is crucial to promote critical thinking and reflection during interaction. One approach we are focusing on involves encouraging reflection during machine-assisted decision-making by presenting decision-makers with data-driven questions. In this short paper, we provide a brief overview of our work in that regard, namely: 1) the development of a question taxonomy, 2) the development of a prototype in the medical domain and the feedback received from clinicians, 3) a method for generating questions using a large language model, and 4) a proposed scale for measuring cognitive engagement in human-AI decision-making. In doing so, we contribute to the discussion about the design, development, and evaluation of tools for thought, i.e., AI systems that provoke critical thinking and enable novel ways of sense-making. |
| title | Supporting Reflection and Forward-Looking Reasoning With Data-Driven Questions |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2603.27318 |