A Simple Ensemble Strategy for LLM Inference: Towards More Stable Text Classification
Fuente:
arXiv
Enregistré dans:
| Auteur principal: | |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910930856574976 |
|---|---|
| author | Niimi, Junichiro |
| author_facet | Niimi, Junichiro |
| contents | With the advance of large language models (LLMs), LLMs have been utilized for the various tasks. However, the issues of variability and reproducibility of results from each trial of LLMs have been largely overlooked in existing literature while actual human annotation uses majority voting to resolve disagreements among annotators. Therefore, this study introduces the straightforward ensemble strategy to a sentiment analysis using LLMs. As the results, we demonstrate that the ensemble of multiple inference using medium-sized LLMs produces more robust and accurate results than using a large model with a single attempt with reducing RMSE by 18.6%. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_18884 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Simple Ensemble Strategy for LLM Inference: Towards More Stable Text Classification Niimi, Junichiro Computation and Language Artificial Intelligence With the advance of large language models (LLMs), LLMs have been utilized for the various tasks. However, the issues of variability and reproducibility of results from each trial of LLMs have been largely overlooked in existing literature while actual human annotation uses majority voting to resolve disagreements among annotators. Therefore, this study introduces the straightforward ensemble strategy to a sentiment analysis using LLMs. As the results, we demonstrate that the ensemble of multiple inference using medium-sized LLMs produces more robust and accurate results than using a large model with a single attempt with reducing RMSE by 18.6%. |
| title | A Simple Ensemble Strategy for LLM Inference: Towards More Stable Text Classification |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2504.18884 |