A Reference Architecture for Designing Foundation Model based Systems

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lu, Qinghua, Zhu, Liming, Xu, Xiwei, Xing, Zhenchang, Whittle, Jon
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911956114341888
author Lu, Qinghua
Zhu, Liming
Xu, Xiwei
Xing, Zhenchang
Whittle, Jon
author_facet Lu, Qinghua
Zhu, Liming
Xu, Xiwei
Xing, Zhenchang
Whittle, Jon
contents The release of ChatGPT, Gemini, and other large language model has drawn huge interests on foundations models. There is a broad consensus that foundations models will be the fundamental building blocks for future AI systems. However, there is a lack of systematic guidance on the architecture design. Particularly, the the rapidly growing capabilities of foundations models can eventually absorb other components of AI systems, posing challenges of moving boundary and interface evolution in architecture design. Furthermore, incorporating foundations models into AI systems raises significant concerns about responsible and safe AI due to their opaque nature and rapidly advancing intelligence. To address these challenges, the paper first presents an architecture evolution of AI systems in the era of foundation models, transitioning from "foundation-model-as-a-connector" to "foundation-model-as-a-monolithic architecture". The paper then identifies key design decisions and proposes a pattern-oriented reference architecture for designing responsible foundation-model-based systems. The patterns can enable the potential of foundation models while ensuring associated risks.
format Preprint
id arxiv_https___arxiv_org_abs_2304_11090
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A Reference Architecture for Designing Foundation Model based Systems
Lu, Qinghua
Zhu, Liming
Xu, Xiwei
Xing, Zhenchang
Whittle, Jon
Computation and Language
Artificial Intelligence
Software Engineering
The release of ChatGPT, Gemini, and other large language model has drawn huge interests on foundations models. There is a broad consensus that foundations models will be the fundamental building blocks for future AI systems. However, there is a lack of systematic guidance on the architecture design. Particularly, the the rapidly growing capabilities of foundations models can eventually absorb other components of AI systems, posing challenges of moving boundary and interface evolution in architecture design. Furthermore, incorporating foundations models into AI systems raises significant concerns about responsible and safe AI due to their opaque nature and rapidly advancing intelligence. To address these challenges, the paper first presents an architecture evolution of AI systems in the era of foundation models, transitioning from "foundation-model-as-a-connector" to "foundation-model-as-a-monolithic architecture". The paper then identifies key design decisions and proposes a pattern-oriented reference architecture for designing responsible foundation-model-based systems. The patterns can enable the potential of foundation models while ensuring associated risks.
title A Reference Architecture for Designing Foundation Model based Systems
topic Computation and Language
Artificial Intelligence
Software Engineering
url https://arxiv.org/abs/2304.11090