Small Language Models are Good Too: An Empirical Study of Zero-Shot Classification
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914758178897920 |
|---|---|
| author | Lepagnol, Pierre Gerald, Thomas Ghannay, Sahar Servan, Christophe Rosset, Sophie |
| author_facet | Lepagnol, Pierre Gerald, Thomas Ghannay, Sahar Servan, Christophe Rosset, Sophie |
| contents | This study is part of the debate on the efficiency of large versus small language models for text classification by prompting.We assess the performance of small language models in zero-shot text classification, challenging the prevailing dominance of large models.Across 15 datasets, our investigation benchmarks language models from 77M to 40B parameters using different architectures and scoring functions. Our findings reveal that small models can effectively classify texts, getting on par with or surpassing their larger counterparts.We developed and shared a comprehensive open-source repository that encapsulates our methodologies. This research underscores the notion that bigger isn't always better, suggesting that resource-efficient small models may offer viable solutions for specific data classification challenges. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_11122 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Small Language Models are Good Too: An Empirical Study of Zero-Shot Classification Lepagnol, Pierre Gerald, Thomas Ghannay, Sahar Servan, Christophe Rosset, Sophie Artificial Intelligence This study is part of the debate on the efficiency of large versus small language models for text classification by prompting.We assess the performance of small language models in zero-shot text classification, challenging the prevailing dominance of large models.Across 15 datasets, our investigation benchmarks language models from 77M to 40B parameters using different architectures and scoring functions. Our findings reveal that small models can effectively classify texts, getting on par with or surpassing their larger counterparts.We developed and shared a comprehensive open-source repository that encapsulates our methodologies. This research underscores the notion that bigger isn't always better, suggesting that resource-efficient small models may offer viable solutions for specific data classification challenges. |
| title | Small Language Models are Good Too: An Empirical Study of Zero-Shot Classification |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2404.11122 |