Empowering Children to Create AI-Enabled Augmented Reality Experiences
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913985562935296 |
|---|---|
| author | Zhang, Lei Zhou, Shuyao Liaqat, Amna Mak, Tinney Berengard, Brian Qian, Emily Monroy-Hernández, Andrés |
| author_facet | Zhang, Lei Zhou, Shuyao Liaqat, Amna Mak, Tinney Berengard, Brian Qian, Emily Monroy-Hernández, Andrés |
| contents | Despite their potential to enhance children's learning experiences, AI-enabled AR technologies are predominantly used in ways that position children as consumers rather than creators. We introduce Capybara, an AR-based and AI-powered visual programming environment that empowers children to create, customize, and program 3D characters overlaid onto the physical world. Capybara enables children to create virtual characters and accessories using text-to-3D generative AI models, and to animate these characters through auto-rigging and body tracking. In addition, our system employs vision-based AI models to recognize physical objects, allowing children to program interactive behaviors between virtual characters and their physical surroundings. We demonstrate the expressiveness of Capybara through a set of novel AR experiences. We conducted user studies with 20 children in the United States and Argentina. Our findings suggest that Capybara can empower children to harness AI in authoring personalized and engaging AR experiences that seamlessly bridge the virtual and physical worlds. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_08467 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Empowering Children to Create AI-Enabled Augmented Reality Experiences Zhang, Lei Zhou, Shuyao Liaqat, Amna Mak, Tinney Berengard, Brian Qian, Emily Monroy-Hernández, Andrés Human-Computer Interaction Artificial Intelligence Graphics Programming Languages Despite their potential to enhance children's learning experiences, AI-enabled AR technologies are predominantly used in ways that position children as consumers rather than creators. We introduce Capybara, an AR-based and AI-powered visual programming environment that empowers children to create, customize, and program 3D characters overlaid onto the physical world. Capybara enables children to create virtual characters and accessories using text-to-3D generative AI models, and to animate these characters through auto-rigging and body tracking. In addition, our system employs vision-based AI models to recognize physical objects, allowing children to program interactive behaviors between virtual characters and their physical surroundings. We demonstrate the expressiveness of Capybara through a set of novel AR experiences. We conducted user studies with 20 children in the United States and Argentina. Our findings suggest that Capybara can empower children to harness AI in authoring personalized and engaging AR experiences that seamlessly bridge the virtual and physical worlds. |
| title | Empowering Children to Create AI-Enabled Augmented Reality Experiences |
| topic | Human-Computer Interaction Artificial Intelligence Graphics Programming Languages |
| url | https://arxiv.org/abs/2508.08467 |