RASSAR: Room Accessibility and Safety Scanning in Augmented Reality

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Su, Xia, Zhang, Han, Cheng, Kaiming, Lee, Jaewook, Liu, Qiaochu, Olson, Wyatt, Froehlich, Jon
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916201164177408
author Su, Xia
Zhang, Han
Cheng, Kaiming
Lee, Jaewook
Liu, Qiaochu
Olson, Wyatt
Froehlich, Jon
author_facet Su, Xia
Zhang, Han
Cheng, Kaiming
Lee, Jaewook
Liu, Qiaochu
Olson, Wyatt
Froehlich, Jon
contents The safety and accessibility of our homes is critical to quality of life and evolves as we age, become ill, host guests, or experience life events such as having children. Researchers and health professionals have created assessment instruments such as checklists that enable homeowners and trained experts to identify and mitigate safety and access issues. With advances in computer vision, augmented reality (AR), and mobile sensors, new approaches are now possible. We introduce RASSAR, a mobile AR application for semi-automatically identifying, localizing, and visualizing indoor accessibility and safety issues such as an inaccessible table height or unsafe loose rugs using LiDAR and real-time computer vision. We present findings from three studies: a formative study with 18 participants across five stakeholder groups to inform the design of RASSAR, a technical performance evaluation across ten homes demonstrating state-of-the-art performance, and a user study with six stakeholders. We close with a discussion of future AI-based indoor accessibility assessment tools, RASSAR's extensibility, and key application scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2404_07479
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle RASSAR: Room Accessibility and Safety Scanning in Augmented Reality
Su, Xia
Zhang, Han
Cheng, Kaiming
Lee, Jaewook
Liu, Qiaochu
Olson, Wyatt
Froehlich, Jon
Human-Computer Interaction
The safety and accessibility of our homes is critical to quality of life and evolves as we age, become ill, host guests, or experience life events such as having children. Researchers and health professionals have created assessment instruments such as checklists that enable homeowners and trained experts to identify and mitigate safety and access issues. With advances in computer vision, augmented reality (AR), and mobile sensors, new approaches are now possible. We introduce RASSAR, a mobile AR application for semi-automatically identifying, localizing, and visualizing indoor accessibility and safety issues such as an inaccessible table height or unsafe loose rugs using LiDAR and real-time computer vision. We present findings from three studies: a formative study with 18 participants across five stakeholder groups to inform the design of RASSAR, a technical performance evaluation across ten homes demonstrating state-of-the-art performance, and a user study with six stakeholders. We close with a discussion of future AI-based indoor accessibility assessment tools, RASSAR's extensibility, and key application scenarios.
title RASSAR: Room Accessibility and Safety Scanning in Augmented Reality
topic Human-Computer Interaction
url https://arxiv.org/abs/2404.07479