Metabook: A Mobile-to-Headset Pipeline for 3D Story Book Creation in Augmented Reality
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912528608526336 |
|---|---|
| author | Wang, Yibo Mao, Yuanyuan Lee, Lik-Hang Ni, Shi-ting Wang, Zeyu Gu, Xiaole Hui, Pan |
| author_facet | Wang, Yibo Mao, Yuanyuan Lee, Lik-Hang Ni, Shi-ting Wang, Zeyu Gu, Xiaole Hui, Pan |
| contents | The AR 3D book has shown significant potential in enhancing students' learning outcomes. However, the creation process of 3D books requires a significant investment of time, effort, and specialized skills. Thus, in this paper, we first conduct a three-day workshop investigating how AI can support the automated creation of 3D books. Informed by the design insights derived from the workshop, we developed Metabook, a system that enables even novice users to create 3D books from text automatically. To our knowledge, Metabook is the first system to offer end-to-end 3D book generation. A follow-up study with adult users indicates that Metabook enables inexperienced users to create 3D books, achieving reduced efforts and shortened preparation time. We subsequently recruited 22 children to examine the effects of AR 3D books on children's learning compared with paper-based books. The findings indicate that 3D books significantly enhance children's interest, improve memory retention, and reduce cognitive load, though no significant improvement was observed in comprehension. We conclude by discussing strategies for more effectively leveraging 3D books to support children's learning and offer practical recommendations for educators. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_13701 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Metabook: A Mobile-to-Headset Pipeline for 3D Story Book Creation in Augmented Reality Wang, Yibo Mao, Yuanyuan Lee, Lik-Hang Ni, Shi-ting Wang, Zeyu Gu, Xiaole Hui, Pan Human-Computer Interaction The AR 3D book has shown significant potential in enhancing students' learning outcomes. However, the creation process of 3D books requires a significant investment of time, effort, and specialized skills. Thus, in this paper, we first conduct a three-day workshop investigating how AI can support the automated creation of 3D books. Informed by the design insights derived from the workshop, we developed Metabook, a system that enables even novice users to create 3D books from text automatically. To our knowledge, Metabook is the first system to offer end-to-end 3D book generation. A follow-up study with adult users indicates that Metabook enables inexperienced users to create 3D books, achieving reduced efforts and shortened preparation time. We subsequently recruited 22 children to examine the effects of AR 3D books on children's learning compared with paper-based books. The findings indicate that 3D books significantly enhance children's interest, improve memory retention, and reduce cognitive load, though no significant improvement was observed in comprehension. We conclude by discussing strategies for more effectively leveraging 3D books to support children's learning and offer practical recommendations for educators. |
| title | Metabook: A Mobile-to-Headset Pipeline for 3D Story Book Creation in Augmented Reality |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2405.13701 |