A Functional Software Reference Architecture for LLM-Integrated Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bucaioni, Alessio, Weyssow, Martin, He, Junda, Lyu, Yunbo, Lo, David
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912199583203328
author Bucaioni, Alessio
Weyssow, Martin
He, Junda
Lyu, Yunbo
Lo, David
author_facet Bucaioni, Alessio
Weyssow, Martin
He, Junda
Lyu, Yunbo
Lo, David
contents The integration of large language models into software systems is transforming capabilities such as natural language understanding, decision-making, and autonomous task execution. However, the absence of a commonly accepted software reference architecture hinders systematic reasoning about their design and quality attributes. This gap makes it challenging to address critical concerns like privacy, security, modularity, and interoperability, which are increasingly important as these systems grow in complexity and societal impact. In this paper, we describe our \textit{emerging} results for a preliminary functional reference architecture as a conceptual framework to address these challenges and guide the design, evaluation, and evolution of large language model-integrated systems. We identify key architectural concerns for these systems, informed by current research and practice. We then evaluate how the architecture addresses these concerns and validate its applicability using three open-source large language model-integrated systems in computer vision, text processing, and coding.
format Preprint
id arxiv_https___arxiv_org_abs_2501_12904
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Functional Software Reference Architecture for LLM-Integrated Systems
Bucaioni, Alessio
Weyssow, Martin
He, Junda
Lyu, Yunbo
Lo, David
Software Engineering
The integration of large language models into software systems is transforming capabilities such as natural language understanding, decision-making, and autonomous task execution. However, the absence of a commonly accepted software reference architecture hinders systematic reasoning about their design and quality attributes. This gap makes it challenging to address critical concerns like privacy, security, modularity, and interoperability, which are increasingly important as these systems grow in complexity and societal impact. In this paper, we describe our \textit{emerging} results for a preliminary functional reference architecture as a conceptual framework to address these challenges and guide the design, evaluation, and evolution of large language model-integrated systems. We identify key architectural concerns for these systems, informed by current research and practice. We then evaluate how the architecture addresses these concerns and validate its applicability using three open-source large language model-integrated systems in computer vision, text processing, and coding.
title A Functional Software Reference Architecture for LLM-Integrated Systems
topic Software Engineering
url https://arxiv.org/abs/2501.12904