IllusionX: An LLM-powered mixed reality personal companion

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yousri, Ramez, Essam, Zeyad, Kareem, Yehia, Sherief, Youstina, Gamil, Sherry, Safwat, Soha
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916123231911936
author Yousri, Ramez
Essam, Zeyad
Kareem, Yehia
Sherief, Youstina
Gamil, Sherry
Safwat, Soha
author_facet Yousri, Ramez
Essam, Zeyad
Kareem, Yehia
Sherief, Youstina
Gamil, Sherry
Safwat, Soha
contents Mixed Reality (MR) and Artificial Intelligence (AI) are increasingly becoming integral parts of our daily lives. Their applications range in fields from healthcare to education to entertainment. MR has opened a new frontier for such fields as well as new methods of enhancing user engagement. In this paper, We propose a new system one that combines the power of Large Language Models (LLMs) and mixed reality (MR) to provide a personalized companion for educational purposes. We present an overview of its structure and components as well tests to measure its performance. We found that our system is better in generating coherent information, however it's rather limited by the documents provided to it. This interdisciplinary approach aims to provide a better user experience and enhance user engagement. The user can interact with the system through a custom-design smart watch, smart glasses and a mobile app.
format Preprint
id arxiv_https___arxiv_org_abs_2402_07924
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle IllusionX: An LLM-powered mixed reality personal companion
Yousri, Ramez
Essam, Zeyad
Kareem, Yehia
Sherief, Youstina
Gamil, Sherry
Safwat, Soha
Human-Computer Interaction
Multimedia
Mixed Reality (MR) and Artificial Intelligence (AI) are increasingly becoming integral parts of our daily lives. Their applications range in fields from healthcare to education to entertainment. MR has opened a new frontier for such fields as well as new methods of enhancing user engagement. In this paper, We propose a new system one that combines the power of Large Language Models (LLMs) and mixed reality (MR) to provide a personalized companion for educational purposes. We present an overview of its structure and components as well tests to measure its performance. We found that our system is better in generating coherent information, however it's rather limited by the documents provided to it. This interdisciplinary approach aims to provide a better user experience and enhance user engagement. The user can interact with the system through a custom-design smart watch, smart glasses and a mobile app.
title IllusionX: An LLM-powered mixed reality personal companion
topic Human-Computer Interaction
Multimedia
url https://arxiv.org/abs/2402.07924