Bridging Industrial Expertise and XR with LLM-Powered Conversational Agents

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Tomkou, Despina, Fatouros, George, Andreou, Andreas, Makridis, Georgios, Liarokapis, Fotis, Dardanis, Dimitrios, Kiourtis, Athanasios, Soldatos, John, Kyriazis, Dimosthenis
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911256529600512
author Tomkou, Despina
Fatouros, George
Andreou, Andreas
Makridis, Georgios
Liarokapis, Fotis
Dardanis, Dimitrios
Kiourtis, Athanasios
Soldatos, John
Kyriazis, Dimosthenis
author_facet Tomkou, Despina
Fatouros, George
Andreou, Andreas
Makridis, Georgios
Liarokapis, Fotis
Dardanis, Dimitrios
Kiourtis, Athanasios
Soldatos, John
Kyriazis, Dimosthenis
contents This paper introduces a novel integration of Retrieval-Augmented Generation (RAG) enhanced Large Language Models (LLMs) with Extended Reality (XR) technologies to address knowledge transfer challenges in industrial environments. The proposed system embeds domain-specific industrial knowledge into XR environments through a natural language interface, enabling hands-free, context-aware expert guidance for workers. We present the architecture of the proposed system consisting of an LLM Chat Engine with dynamic tool orchestration and an XR application featuring voice-driven interaction. Performance evaluation of various chunking strategies, embedding models, and vector databases reveals that semantic chunking, balanced embedding models, and efficient vector stores deliver optimal performance for industrial knowledge retrieval. The system's potential is demonstrated through early implementation in multiple industrial use cases, including robotic assembly, smart infrastructure maintenance, and aerospace component servicing. Results indicate potential for enhancing training efficiency, remote assistance capabilities, and operational guidance in alignment with Industry 5.0's human-centric and resilient approach to industrial development.
format Preprint
id arxiv_https___arxiv_org_abs_2504_05527
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bridging Industrial Expertise and XR with LLM-Powered Conversational Agents
Tomkou, Despina
Fatouros, George
Andreou, Andreas
Makridis, Georgios
Liarokapis, Fotis
Dardanis, Dimitrios
Kiourtis, Athanasios
Soldatos, John
Kyriazis, Dimosthenis
Computation and Language
Artificial Intelligence
68T50, 68T40, 68U20, 68U35
H.5.1; I.2.7; I.2.11; H.3.3; H.5.2; C.3
This paper introduces a novel integration of Retrieval-Augmented Generation (RAG) enhanced Large Language Models (LLMs) with Extended Reality (XR) technologies to address knowledge transfer challenges in industrial environments. The proposed system embeds domain-specific industrial knowledge into XR environments through a natural language interface, enabling hands-free, context-aware expert guidance for workers. We present the architecture of the proposed system consisting of an LLM Chat Engine with dynamic tool orchestration and an XR application featuring voice-driven interaction. Performance evaluation of various chunking strategies, embedding models, and vector databases reveals that semantic chunking, balanced embedding models, and efficient vector stores deliver optimal performance for industrial knowledge retrieval. The system's potential is demonstrated through early implementation in multiple industrial use cases, including robotic assembly, smart infrastructure maintenance, and aerospace component servicing. Results indicate potential for enhancing training efficiency, remote assistance capabilities, and operational guidance in alignment with Industry 5.0's human-centric and resilient approach to industrial development.
title Bridging Industrial Expertise and XR with LLM-Powered Conversational Agents
topic Computation and Language
Artificial Intelligence
68T50, 68T40, 68U20, 68U35
H.5.1; I.2.7; I.2.11; H.3.3; H.5.2; C.3
url https://arxiv.org/abs/2504.05527