Evaluating LLMs and Pre-trained Models for Text Summarization Across Diverse Datasets
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909536619593728 |
|---|---|
| author | Rehman, Tohida Ghosh, Soumabha Das, Kuntal Bhattacharjee, Souvik Sanyal, Debarshi Kumar Chattopadhyay, Samiran |
| author_facet | Rehman, Tohida Ghosh, Soumabha Das, Kuntal Bhattacharjee, Souvik Sanyal, Debarshi Kumar Chattopadhyay, Samiran |
| contents | Text summarization plays a crucial role in natural language processing by condensing large volumes of text into concise and coherent summaries. As digital content continues to grow rapidly and the demand for effective information retrieval increases, text summarization has become a focal point of research in recent years. This study offers a thorough evaluation of four leading pre-trained and open-source large language models: BART, FLAN-T5, LLaMA-3-8B, and Gemma-7B, across five diverse datasets CNN/DM, Gigaword, News Summary, XSum, and BBC News. The evaluation employs widely recognized automatic metrics, including ROUGE-1, ROUGE-2, ROUGE-L, BERTScore, and METEOR, to assess the models' capabilities in generating coherent and informative summaries. The results reveal the comparative strengths and limitations of these models in processing various text types. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_19339 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Evaluating LLMs and Pre-trained Models for Text Summarization Across Diverse Datasets Rehman, Tohida Ghosh, Soumabha Das, Kuntal Bhattacharjee, Souvik Sanyal, Debarshi Kumar Chattopadhyay, Samiran Computation and Language Text summarization plays a crucial role in natural language processing by condensing large volumes of text into concise and coherent summaries. As digital content continues to grow rapidly and the demand for effective information retrieval increases, text summarization has become a focal point of research in recent years. This study offers a thorough evaluation of four leading pre-trained and open-source large language models: BART, FLAN-T5, LLaMA-3-8B, and Gemma-7B, across five diverse datasets CNN/DM, Gigaword, News Summary, XSum, and BBC News. The evaluation employs widely recognized automatic metrics, including ROUGE-1, ROUGE-2, ROUGE-L, BERTScore, and METEOR, to assess the models' capabilities in generating coherent and informative summaries. The results reveal the comparative strengths and limitations of these models in processing various text types. |
| title | Evaluating LLMs and Pre-trained Models for Text Summarization Across Diverse Datasets |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2502.19339 |