Towards an End-to-End System for 3D Tracking of Physical Objects in Virtual Immersive Environments
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909013065596928 |
|---|---|
| author | Knapiński, Stanisław Grzeszczuk, Maciej Karpowicz, Barbara Zinevych, Pavlo Kopec, Wieslaw |
| author_facet | Knapiński, Stanisław Grzeszczuk, Maciej Karpowicz, Barbara Zinevych, Pavlo Kopec, Wieslaw |
| contents | This work aims to establish an end-to-end system for tracking of physical 3D objects for virtual reality (VR) applications. We focus on training applications requiring real-time tracking of the position of small physical objects and their reflection in VR space. Out goal is to perform object tracking in a "plug and play" manner, without using complex systems with quite large tracking devices or manually implementing object tracking. We therefore propose a system for object tracking via fiducial markers alongside a software harness, to enable fast and efficient designation of objects to be tracked and data streaming solution for end-use applications. The system utilizes AruCo, AprilTag and an original Colored Control Points based fiducial system. It allows for easy tag detection and use of object position data, which are crucial for immersive training environments based on VR and eXtended Reality (XR). We evaluate various tag sizes, detection distances, and different camera devices against the theoretical limits. In effect, we create a complete solution for implementing marker-based, real-to-virtual object position mapping for various applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_02901 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Towards an End-to-End System for 3D Tracking of Physical Objects in Virtual Immersive Environments Knapiński, Stanisław Grzeszczuk, Maciej Karpowicz, Barbara Zinevych, Pavlo Kopec, Wieslaw Human-Computer Interaction Computer Vision and Pattern Recognition This work aims to establish an end-to-end system for tracking of physical 3D objects for virtual reality (VR) applications. We focus on training applications requiring real-time tracking of the position of small physical objects and their reflection in VR space. Out goal is to perform object tracking in a "plug and play" manner, without using complex systems with quite large tracking devices or manually implementing object tracking. We therefore propose a system for object tracking via fiducial markers alongside a software harness, to enable fast and efficient designation of objects to be tracked and data streaming solution for end-use applications. The system utilizes AruCo, AprilTag and an original Colored Control Points based fiducial system. It allows for easy tag detection and use of object position data, which are crucial for immersive training environments based on VR and eXtended Reality (XR). We evaluate various tag sizes, detection distances, and different camera devices against the theoretical limits. In effect, we create a complete solution for implementing marker-based, real-to-virtual object position mapping for various applications. |
| title | Towards an End-to-End System for 3D Tracking of Physical Objects in Virtual Immersive Environments |
| topic | Human-Computer Interaction Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2605.02901 |