FernUni LLM Experimental Infrastructure (FLEXI) -- Enabling Experimentation and Innovation in Higher Education Through Access to Open Large Language Models

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zesch, Torsten, Hanses, Michael, Seidel, Niels, Aggarwal, Piush, Veiel, Dirk, de Witt, Claudia
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916328805236736
author Zesch, Torsten
Hanses, Michael
Seidel, Niels
Aggarwal, Piush
Veiel, Dirk
de Witt, Claudia
author_facet Zesch, Torsten
Hanses, Michael
Seidel, Niels
Aggarwal, Piush
Veiel, Dirk
de Witt, Claudia
contents Using the full potential of LLMs in higher education is hindered by challenges with access to LLMs. The two main access modes currently discussed are paying for a cloud-based LLM or providing a locally maintained open LLM. In this paper, we describe the current state of establishing an open LLM infrastructure at FernUniversität in Hagen under the project name FLEXI (FernUni LLM Experimental Infrastructure). FLEXI enables experimentation within teaching and research with the goal of generating strongly needed evidence in favor (or against) the use of locally maintained open LLMs in higher education. The paper will provide some practical guidance for everyone trying to decide whether to run their own LLM server.
format Preprint
id arxiv_https___arxiv_org_abs_2407_13013
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle FernUni LLM Experimental Infrastructure (FLEXI) -- Enabling Experimentation and Innovation in Higher Education Through Access to Open Large Language Models
Zesch, Torsten
Hanses, Michael
Seidel, Niels
Aggarwal, Piush
Veiel, Dirk
de Witt, Claudia
Computers and Society
Artificial Intelligence
Using the full potential of LLMs in higher education is hindered by challenges with access to LLMs. The two main access modes currently discussed are paying for a cloud-based LLM or providing a locally maintained open LLM. In this paper, we describe the current state of establishing an open LLM infrastructure at FernUniversität in Hagen under the project name FLEXI (FernUni LLM Experimental Infrastructure). FLEXI enables experimentation within teaching and research with the goal of generating strongly needed evidence in favor (or against) the use of locally maintained open LLMs in higher education. The paper will provide some practical guidance for everyone trying to decide whether to run their own LLM server.
title FernUni LLM Experimental Infrastructure (FLEXI) -- Enabling Experimentation and Innovation in Higher Education Through Access to Open Large Language Models
topic Computers and Society
Artificial Intelligence
url https://arxiv.org/abs/2407.13013