A Layered Architecture for Developing and Enhancing Capabilities in Large Language Model-based Software Systems
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917841281744896 |
|---|---|
| author | Zhang, Dawen Xu, Xiwei Wang, Chen Xing, Zhenchang Mao, Robert |
| author_facet | Zhang, Dawen Xu, Xiwei Wang, Chen Xing, Zhenchang Mao, Robert |
| contents | Significant efforts has been made to expand the use of Large Language Models (LLMs) beyond basic language tasks. While the generalizability and versatility of LLMs have enabled widespread adoption, evolving demands in application development often exceed their native capabilities. Meeting these demands may involve a diverse set of methods, such as enhancing creativity through either inference temperature adjustments or creativity-provoking prompts. Selecting the right approach is critical, as different methods lead to trade-offs in engineering complexity, scalability, and operational costs. This paper introduces a layered architecture that organizes LLM software system development into distinct layers, each characterized by specific attributes. By aligning capabilities with these layers, the framework encourages the systematic implementation of capabilities in effective and efficient ways that ultimately supports desired functionalities and qualities. Through practical case studies, we illustrate the utility of the framework. This work offers developers actionable insights for selecting suitable technologies in LLM-based software system development, promoting robustness and scalability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_12357 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Layered Architecture for Developing and Enhancing Capabilities in Large Language Model-based Software Systems Zhang, Dawen Xu, Xiwei Wang, Chen Xing, Zhenchang Mao, Robert Software Engineering Artificial Intelligence Computation and Language Multiagent Systems Significant efforts has been made to expand the use of Large Language Models (LLMs) beyond basic language tasks. While the generalizability and versatility of LLMs have enabled widespread adoption, evolving demands in application development often exceed their native capabilities. Meeting these demands may involve a diverse set of methods, such as enhancing creativity through either inference temperature adjustments or creativity-provoking prompts. Selecting the right approach is critical, as different methods lead to trade-offs in engineering complexity, scalability, and operational costs. This paper introduces a layered architecture that organizes LLM software system development into distinct layers, each characterized by specific attributes. By aligning capabilities with these layers, the framework encourages the systematic implementation of capabilities in effective and efficient ways that ultimately supports desired functionalities and qualities. Through practical case studies, we illustrate the utility of the framework. This work offers developers actionable insights for selecting suitable technologies in LLM-based software system development, promoting robustness and scalability. |
| title | A Layered Architecture for Developing and Enhancing Capabilities in Large Language Model-based Software Systems |
| topic | Software Engineering Artificial Intelligence Computation and Language Multiagent Systems |
| url | https://arxiv.org/abs/2411.12357 |