Domain-specific ReAct for physics-integrated iterative modeling: A case study of LLM agents for gas path analysis of gas turbines

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Song, Tao, Fan, Yuwei, Feng, Chenlong, Song, Keyu, Liu, Chao, Jiang, Dongxiang
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929382551977984
author Song, Tao
Fan, Yuwei
Feng, Chenlong
Song, Keyu
Liu, Chao
Jiang, Dongxiang
author_facet Song, Tao
Fan, Yuwei
Feng, Chenlong
Song, Keyu
Liu, Chao
Jiang, Dongxiang
contents This study explores the application of large language models (LLMs) with callable tools in energy and power engineering domain, focusing on gas path analysis of gas turbines. We developed a dual-agent tool-calling process to integrate expert knowledge, predefined tools, and LLM reasoning. We evaluated various LLMs, including LLama3, Qwen1.5 and GPT. Smaller models struggled with tool usage and parameter extraction, while larger models demonstrated favorable capabilities. All models faced challenges with complex, multi-component problems. Based on the test results, we infer that LLMs with nearly 100 billion parameters could meet professional scenario requirements with fine-tuning and advanced prompt design. Continued development are likely to enhance their accuracy and effectiveness, paving the way for more robust AI-driven solutions.
format Preprint
id arxiv_https___arxiv_org_abs_2406_07572
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Domain-specific ReAct for physics-integrated iterative modeling: A case study of LLM agents for gas path analysis of gas turbines
Song, Tao
Fan, Yuwei
Feng, Chenlong
Song, Keyu
Liu, Chao
Jiang, Dongxiang
Artificial Intelligence
Computational Engineering, Finance, and Science
Machine Learning
This study explores the application of large language models (LLMs) with callable tools in energy and power engineering domain, focusing on gas path analysis of gas turbines. We developed a dual-agent tool-calling process to integrate expert knowledge, predefined tools, and LLM reasoning. We evaluated various LLMs, including LLama3, Qwen1.5 and GPT. Smaller models struggled with tool usage and parameter extraction, while larger models demonstrated favorable capabilities. All models faced challenges with complex, multi-component problems. Based on the test results, we infer that LLMs with nearly 100 billion parameters could meet professional scenario requirements with fine-tuning and advanced prompt design. Continued development are likely to enhance their accuracy and effectiveness, paving the way for more robust AI-driven solutions.
title Domain-specific ReAct for physics-integrated iterative modeling: A case study of LLM agents for gas path analysis of gas turbines
topic Artificial Intelligence
Computational Engineering, Finance, and Science
Machine Learning
url https://arxiv.org/abs/2406.07572