Datenschutzkonformer LLM-Einsatz: Eine Open-Source-Referenzarchitektur
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909523897221120 |
|---|---|
| author | Lambert, Marian Schuster, Thomas Döring, Nico Krüger, Robin |
| author_facet | Lambert, Marian Schuster, Thomas Döring, Nico Krüger, Robin |
| contents | The development of Large Language Models (LLMs) has led to significant advancements in natural language processing and enabled numerous applications across various industries. However, many LLM-based solutions operate as open systems relying on cloud services, which pose risks to data confidentiality and security. To address these challenges, organizations require closed LLM systems that comply with data protection regulations while maintaining high performance. In this paper, we present a reference architecture for developing closed, LLM-based systems using open-source technologies. The architecture provides a flexible and transparent solution that meets strict data privacy and security requirements. We analyze the key challenges in implementing such systems, including computing resources, data management, scalability, and security risks. Additionally, we introduce an evaluation pipeline that enables a systematic assessment of system performance and compliance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_01915 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Datenschutzkonformer LLM-Einsatz: Eine Open-Source-Referenzarchitektur Lambert, Marian Schuster, Thomas Döring, Nico Krüger, Robin Cryptography and Security The development of Large Language Models (LLMs) has led to significant advancements in natural language processing and enabled numerous applications across various industries. However, many LLM-based solutions operate as open systems relying on cloud services, which pose risks to data confidentiality and security. To address these challenges, organizations require closed LLM systems that comply with data protection regulations while maintaining high performance. In this paper, we present a reference architecture for developing closed, LLM-based systems using open-source technologies. The architecture provides a flexible and transparent solution that meets strict data privacy and security requirements. We analyze the key challenges in implementing such systems, including computing resources, data management, scalability, and security risks. Additionally, we introduce an evaluation pipeline that enables a systematic assessment of system performance and compliance. |
| title | Datenschutzkonformer LLM-Einsatz: Eine Open-Source-Referenzarchitektur |
| topic | Cryptography and Security |
| url | https://arxiv.org/abs/2503.01915 |