ARfy: A Pipeline for Adapting 3D Scenes to Augmented Reality

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Caetano, Arthur, Sra, Misha
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929583502131200
author Caetano, Arthur
Sra, Misha
author_facet Caetano, Arthur
Sra, Misha
contents Virtual content placement in physical scenes is a crucial aspect of augmented reality (AR). This task is particularly challenging when the virtual elements must adapt to multiple target physical environments that are unknown during development. AR authors use strategies such as manual placement performed by end-users, automated placement powered by author-defined constraints, and procedural content generation to adapt virtual content to physical spaces. Although effective, these options require human effort or annotated virtual assets. As an alternative, we present ARfy, a pipeline to support the adaptive placement of virtual content from pre-existing 3D scenes in arbitrary physical spaces. ARfy does not require intervention by end-users or asset annotation by AR authors. We demonstrate the pipeline capabilities using simulations on a publicly available indoor space dataset. ARfy automatically makes any generic 3D scene AR-ready and provides evaluation tools to facilitate future research on adaptive virtual content placement.
format Preprint
id arxiv_https___arxiv_org_abs_2411_05218
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ARfy: A Pipeline for Adapting 3D Scenes to Augmented Reality
Caetano, Arthur
Sra, Misha
Human-Computer Interaction
Virtual content placement in physical scenes is a crucial aspect of augmented reality (AR). This task is particularly challenging when the virtual elements must adapt to multiple target physical environments that are unknown during development. AR authors use strategies such as manual placement performed by end-users, automated placement powered by author-defined constraints, and procedural content generation to adapt virtual content to physical spaces. Although effective, these options require human effort or annotated virtual assets. As an alternative, we present ARfy, a pipeline to support the adaptive placement of virtual content from pre-existing 3D scenes in arbitrary physical spaces. ARfy does not require intervention by end-users or asset annotation by AR authors. We demonstrate the pipeline capabilities using simulations on a publicly available indoor space dataset. ARfy automatically makes any generic 3D scene AR-ready and provides evaluation tools to facilitate future research on adaptive virtual content placement.
title ARfy: A Pipeline for Adapting 3D Scenes to Augmented Reality
topic Human-Computer Interaction
url https://arxiv.org/abs/2411.05218