Saved in:
Bibliographic Details
Main Authors: Zesch, Torsten, Hanses, Michael, Seidel, Niels, Aggarwal, Piush, Veiel, Dirk, de Witt, Claudia
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.13013
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Using the full potential of LLMs in higher education is hindered by challenges with access to LLMs. The two main access modes currently discussed are paying for a cloud-based LLM or providing a locally maintained open LLM. In this paper, we describe the current state of establishing an open LLM infrastructure at FernUniversität in Hagen under the project name FLEXI (FernUni LLM Experimental Infrastructure). FLEXI enables experimentation within teaching and research with the goal of generating strongly needed evidence in favor (or against) the use of locally maintained open LLMs in higher education. The paper will provide some practical guidance for everyone trying to decide whether to run their own LLM server.