Metaverse‐based remote support system with smooth combination of free viewpoint observation and hand gesture instruction

Fuente: Wiley Open Access
Salvato in:
Dettagli Bibliografici
Autori principali: Takashi Numata, Yuya Ogi, Keiichi Mitani, Kazuyuki Tajima, Yusuke Nakamura, Naohito Ikeda, Kenichi Shimada
Natura: Artículo Open Access
Pubblicazione: Wiley 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1867011133630578688
author Takashi Numata
Yuya Ogi
Keiichi Mitani
Kazuyuki Tajima
Yusuke Nakamura
Naohito Ikeda
Kenichi Shimada
author_facet Takashi Numata
Yuya Ogi
Keiichi Mitani
Kazuyuki Tajima
Yusuke Nakamura
Naohito Ikeda
Kenichi Shimada
Takashi Numata
Yuya Ogi
Keiichi Mitani
Kazuyuki Tajima
Yusuke Nakamura
Naohito Ikeda
Kenichi Shimada
collection Wiley Open Access
contents Metaverse‐based remote support system with smooth combination of free viewpoint observation and hand gesture instruction Takashi Numata Yuya Ogi Keiichi Mitani Kazuyuki Tajima Yusuke Nakamura Naohito Ikeda Kenichi Shimada Journal of the Society for Information Display AbstractIn field operations with large machines, onsite large task spaces have been typically required. In these cases, remote skilled workers have to provide a step‐by‐step guide by observing the onsite situation around the large task spaces in three dimensions, instructing onsite unskilled workers on how to perform the tasks with the correct hand gestures at the right position, and switching between observation and instruction frequently during the remote support. In this study, we developed a Metaverse‐based remote support system with a seamless user interface for switching between free viewpoint observation and hand gesture instruction. The proposed system enables remote skilled workers to observe the onsite field from any viewpoint, transfer hand gesture instruction to onsite workers, and seamlessly switch between free viewpoint observation and free hand gesture instruction without having to change devices. We compared the time efficiency of the proposed system and a conventional system through experiments with 28 users and found that our system improved the observation time efficiency by 65.7%, the instruction time efficiency by 27.9%, and the switching time efficiency between observation and instruction by 14.6%. These results indicate that the proposed system enables remote skilled workers to support onsite workers quickly and efficiently. 10.1002/jsid.1339 http://creativecommons.org/licenses/by-nc-nd/4.0/
doi_str_mv 10.1002/jsid.1339
format Artículo Open Access
id wiley_oa_10_1002_jsid_1339
institution Wiley Open Access
license_str_mv http://creativecommons.org/licenses/by-nc-nd/4.0/
publishDate 2024
publisher Wiley
record_format wiley_oa
spellingShingle Metaverse‐based remote support system with smooth combination of free viewpoint observation and hand gesture instruction
Takashi Numata
Yuya Ogi
Keiichi Mitani
Kazuyuki Tajima
Yusuke Nakamura
Naohito Ikeda
Kenichi Shimada
Journal of the Society for Information Display
Metaverse‐based remote support system with smooth combination of free viewpoint observation and hand gesture instruction Takashi Numata Yuya Ogi Keiichi Mitani Kazuyuki Tajima Yusuke Nakamura Naohito Ikeda Kenichi Shimada Journal of the Society for Information Display AbstractIn field operations with large machines, onsite large task spaces have been typically required. In these cases, remote skilled workers have to provide a step‐by‐step guide by observing the onsite situation around the large task spaces in three dimensions, instructing onsite unskilled workers on how to perform the tasks with the correct hand gestures at the right position, and switching between observation and instruction frequently during the remote support. In this study, we developed a Metaverse‐based remote support system with a seamless user interface for switching between free viewpoint observation and hand gesture instruction. The proposed system enables remote skilled workers to observe the onsite field from any viewpoint, transfer hand gesture instruction to onsite workers, and seamlessly switch between free viewpoint observation and free hand gesture instruction without having to change devices. We compared the time efficiency of the proposed system and a conventional system through experiments with 28 users and found that our system improved the observation time efficiency by 65.7%, the instruction time efficiency by 27.9%, and the switching time efficiency between observation and instruction by 14.6%. These results indicate that the proposed system enables remote skilled workers to support onsite workers quickly and efficiently. 10.1002/jsid.1339 http://creativecommons.org/licenses/by-nc-nd/4.0/
title Metaverse‐based remote support system with smooth combination of free viewpoint observation and hand gesture instruction
topic Journal of the Society for Information Display
url https://sid.onlinelibrary.wiley.com/doi/10.1002/jsid.1339