Enregistré dans:
Détails bibliographiques
Auteurs principaux: Gadiraju, Sai Surya, Liao, Duoduo, Kudupudi, Akhila, Kasula, Santosh, Chalasani, Charitha
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:https://arxiv.org/abs/2412.16412
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915378605588480
author Gadiraju, Sai Surya
Liao, Duoduo
Kudupudi, Akhila
Kasula, Santosh
Chalasani, Charitha
author_facet Gadiraju, Sai Surya
Liao, Duoduo
Kudupudi, Akhila
Kasula, Santosh
Chalasani, Charitha
contents This pilot study presents the development of the InfoTech Assistant, a domain-specific, multimodal chatbot engineered to address queries in bridge evaluation and infrastructure technology. By integrating web data scraping, large language models (LLMs), and Retrieval-Augmented Generation (RAG), the InfoTech Assistant provides accurate and contextually relevant responses. Data, including textual descriptions and images, are sourced from publicly available documents on the InfoTechnology website and organized in JSON format to facilitate efficient querying. The architecture of the system includes an HTML-based interface and a Flask back end connected to the Llama 3.1 model via LLM Studio. Evaluation results show approximately 95 percent accuracy on domain-specific tasks, with high similarity scores confirming the quality of response matching. This RAG-enhanced setup enables the InfoTech Assistant to handle complex, multimodal queries, offering both textual and visual information in its responses. The InfoTech Assistant demonstrates strong potential as a dependable tool for infrastructure professionals, delivering high accuracy and relevance in its domain-specific outputs.
format Preprint
id arxiv_https___arxiv_org_abs_2412_16412
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle InfoTech Assistant: A Multimodal Conversational Agent for InfoTechnology Web Portal Queries
Gadiraju, Sai Surya
Liao, Duoduo
Kudupudi, Akhila
Kasula, Santosh
Chalasani, Charitha
Computation and Language
This pilot study presents the development of the InfoTech Assistant, a domain-specific, multimodal chatbot engineered to address queries in bridge evaluation and infrastructure technology. By integrating web data scraping, large language models (LLMs), and Retrieval-Augmented Generation (RAG), the InfoTech Assistant provides accurate and contextually relevant responses. Data, including textual descriptions and images, are sourced from publicly available documents on the InfoTechnology website and organized in JSON format to facilitate efficient querying. The architecture of the system includes an HTML-based interface and a Flask back end connected to the Llama 3.1 model via LLM Studio. Evaluation results show approximately 95 percent accuracy on domain-specific tasks, with high similarity scores confirming the quality of response matching. This RAG-enhanced setup enables the InfoTech Assistant to handle complex, multimodal queries, offering both textual and visual information in its responses. The InfoTech Assistant demonstrates strong potential as a dependable tool for infrastructure professionals, delivering high accuracy and relevance in its domain-specific outputs.
title InfoTech Assistant: A Multimodal Conversational Agent for InfoTechnology Web Portal Queries
topic Computation and Language
url https://arxiv.org/abs/2412.16412