"AI just keeps guessing": Using ARC Puzzles to Help Children Identify Reasoning Errors in Generative AI
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910964773814272 |
|---|---|
| author | Dangol, Aayushi Zhao, Runhua Wolfe, Robert Ramanan, Trushaa Kientz, Julie A. Yip, Jason |
| author_facet | Dangol, Aayushi Zhao, Runhua Wolfe, Robert Ramanan, Trushaa Kientz, Julie A. Yip, Jason |
| contents | The integration of generative Artificial Intelligence (genAI) into everyday life raises questions about the competencies required to critically engage with these technologies. Unlike visual errors in genAI, textual mistakes are often harder to detect and require specific domain knowledge. Furthermore, AI's authoritative tone and structured responses can create an illusion of correctness, leading to overtrust, especially among children. To address this, we developed AI Puzzlers, an interactive system based on the Abstraction and Reasoning Corpus (ARC), to help children identify and analyze errors in genAI. Drawing on Mayer & Moreno's Cognitive Theory of Multimedia Learning, AI Puzzlers uses visual and verbal elements to reduce cognitive overload and support error detection. Based on two participatory design sessions with 21 children (ages 6 - 11), our findings provide both design insights and an empirical understanding of how children identify errors in genAI reasoning, develop strategies for navigating these errors, and evaluate AI outputs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_16034 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | "AI just keeps guessing": Using ARC Puzzles to Help Children Identify Reasoning Errors in Generative AI Dangol, Aayushi Zhao, Runhua Wolfe, Robert Ramanan, Trushaa Kientz, Julie A. Yip, Jason Human-Computer Interaction Computers and Society The integration of generative Artificial Intelligence (genAI) into everyday life raises questions about the competencies required to critically engage with these technologies. Unlike visual errors in genAI, textual mistakes are often harder to detect and require specific domain knowledge. Furthermore, AI's authoritative tone and structured responses can create an illusion of correctness, leading to overtrust, especially among children. To address this, we developed AI Puzzlers, an interactive system based on the Abstraction and Reasoning Corpus (ARC), to help children identify and analyze errors in genAI. Drawing on Mayer & Moreno's Cognitive Theory of Multimedia Learning, AI Puzzlers uses visual and verbal elements to reduce cognitive overload and support error detection. Based on two participatory design sessions with 21 children (ages 6 - 11), our findings provide both design insights and an empirical understanding of how children identify errors in genAI reasoning, develop strategies for navigating these errors, and evaluate AI outputs. |
| title | "AI just keeps guessing": Using ARC Puzzles to Help Children Identify Reasoning Errors in Generative AI |
| topic | Human-Computer Interaction Computers and Society |
| url | https://arxiv.org/abs/2505.16034 |