Control Industrial Automation System with Large Language Model Agents

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Xia, Yuchen, Jazdi, Nasser, Zhang, Jize, Shah, Chaitanya, Weyrich, Michael
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913890601795584
author Xia, Yuchen
Jazdi, Nasser
Zhang, Jize
Shah, Chaitanya
Weyrich, Michael
author_facet Xia, Yuchen
Jazdi, Nasser
Zhang, Jize
Shah, Chaitanya
Weyrich, Michael
contents Traditional industrial automation systems require specialized expertise to operate and complex reprogramming to adapt to new processes. Large language models offer the intelligence to make them more flexible and easier to use. However, LLMs' application in industrial settings is underexplored. This paper introduces a framework for integrating LLMs to achieve end-to-end control of industrial automation systems. At the core of the framework are an agent system designed for industrial tasks, a structured prompting method, and an event-driven information modeling mechanism that provides real-time data for LLM inference. The framework supplies LLMs with real-time events on different context semantic levels, allowing them to interpret the information, generate production plans, and control operations on the automation system. It also supports structured dataset creation for fine-tuning on this downstream application of LLMs. Our contribution includes a formal system design, proof-of-concept implementation, and a method for generating task-specific datasets for LLM fine-tuning and testing. This approach enables a more adaptive automation system that can respond to spontaneous events, while allowing easier operation and configuration through natural language for more intuitive human-machine interaction. We provide demo videos and detailed data on GitHub: https://github.com/YuchenXia/LLM4IAS.
format Preprint
id arxiv_https___arxiv_org_abs_2409_18009
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Control Industrial Automation System with Large Language Model Agents
Xia, Yuchen
Jazdi, Nasser
Zhang, Jize
Shah, Chaitanya
Weyrich, Michael
Systems and Control
Artificial Intelligence
Human-Computer Interaction
Multiagent Systems
Robotics
Traditional industrial automation systems require specialized expertise to operate and complex reprogramming to adapt to new processes. Large language models offer the intelligence to make them more flexible and easier to use. However, LLMs' application in industrial settings is underexplored. This paper introduces a framework for integrating LLMs to achieve end-to-end control of industrial automation systems. At the core of the framework are an agent system designed for industrial tasks, a structured prompting method, and an event-driven information modeling mechanism that provides real-time data for LLM inference. The framework supplies LLMs with real-time events on different context semantic levels, allowing them to interpret the information, generate production plans, and control operations on the automation system. It also supports structured dataset creation for fine-tuning on this downstream application of LLMs. Our contribution includes a formal system design, proof-of-concept implementation, and a method for generating task-specific datasets for LLM fine-tuning and testing. This approach enables a more adaptive automation system that can respond to spontaneous events, while allowing easier operation and configuration through natural language for more intuitive human-machine interaction. We provide demo videos and detailed data on GitHub: https://github.com/YuchenXia/LLM4IAS.
title Control Industrial Automation System with Large Language Model Agents
topic Systems and Control
Artificial Intelligence
Human-Computer Interaction
Multiagent Systems
Robotics
url https://arxiv.org/abs/2409.18009