Mini-Giants: "Small" Language Models and Open Source Win-Win
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913419857231872 |
|---|---|
| author | Zhou, Zhengping Li, Lezhi Chen, Xinxi Li, Andy |
| author_facet | Zhou, Zhengping Li, Lezhi Chen, Xinxi Li, Andy |
| contents | ChatGPT is phenomenal. However, it is prohibitively expensive to train and refine such giant models. Fortunately, small language models are flourishing and becoming more and more competent. We call them "mini-giants". We argue that open source community like Kaggle and mini-giants will win-win in many ways, technically, ethically and socially. In this article, we present a brief yet rich background, discuss how to attain small language models, present a comparative study of small language models and a brief discussion of evaluation methods, discuss the application scenarios where small language models are most needed in the real world, and conclude with discussion and outlook. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_08189 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Mini-Giants: "Small" Language Models and Open Source Win-Win Zhou, Zhengping Li, Lezhi Chen, Xinxi Li, Andy Computation and Language Artificial Intelligence Machine Learning ChatGPT is phenomenal. However, it is prohibitively expensive to train and refine such giant models. Fortunately, small language models are flourishing and becoming more and more competent. We call them "mini-giants". We argue that open source community like Kaggle and mini-giants will win-win in many ways, technically, ethically and socially. In this article, we present a brief yet rich background, discuss how to attain small language models, present a comparative study of small language models and a brief discussion of evaluation methods, discuss the application scenarios where small language models are most needed in the real world, and conclude with discussion and outlook. |
| title | Mini-Giants: "Small" Language Models and Open Source Win-Win |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2307.08189 |