Cross-Format Retrieval-Augmented Generation in XR with LLMs for Context-Aware Maintenance Assistance
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916632702484480 |
|---|---|
| author | Nagy, Akos Spyridis, Yannis Argyriou, Vasileios |
| author_facet | Nagy, Akos Spyridis, Yannis Argyriou, Vasileios |
| contents | This paper presents a detailed evaluation of a Retrieval-Augmented Generation (RAG) system that integrates large language models (LLMs) to enhance information retrieval and instruction generation for maintenance personnel across diverse data formats. We assessed the performance of eight LLMs, emphasizing key metrics such as response speed and accuracy, which were quantified using BLEU and METEOR scores. Our findings reveal that advanced models like GPT-4 and GPT-4o-mini significantly outperform their counterparts, particularly when addressing complex queries requiring multi-format data integration. The results validate the system's ability to deliver timely and accurate responses, highlighting the potential of RAG frameworks to optimize maintenance operations. Future research will focus on refining retrieval techniques for these models and enhancing response generation, particularly for intricate scenarios, ultimately improving the system's practical applicability in dynamic real-world environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_15604 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Cross-Format Retrieval-Augmented Generation in XR with LLMs for Context-Aware Maintenance Assistance Nagy, Akos Spyridis, Yannis Argyriou, Vasileios Information Retrieval Human-Computer Interaction This paper presents a detailed evaluation of a Retrieval-Augmented Generation (RAG) system that integrates large language models (LLMs) to enhance information retrieval and instruction generation for maintenance personnel across diverse data formats. We assessed the performance of eight LLMs, emphasizing key metrics such as response speed and accuracy, which were quantified using BLEU and METEOR scores. Our findings reveal that advanced models like GPT-4 and GPT-4o-mini significantly outperform their counterparts, particularly when addressing complex queries requiring multi-format data integration. The results validate the system's ability to deliver timely and accurate responses, highlighting the potential of RAG frameworks to optimize maintenance operations. Future research will focus on refining retrieval techniques for these models and enhancing response generation, particularly for intricate scenarios, ultimately improving the system's practical applicability in dynamic real-world environments. |
| title | Cross-Format Retrieval-Augmented Generation in XR with LLMs for Context-Aware Maintenance Assistance |
| topic | Information Retrieval Human-Computer Interaction |
| url | https://arxiv.org/abs/2502.15604 |