Saved in:
Bibliographic Details
Main Authors: Tran, Václav, Šmíd, Jakub, Martínek, Jiří, Lenc, Ladislav, Král, Pavel
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2508.10368
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908489886990336
author Tran, Václav
Šmíd, Jakub
Martínek, Jiří
Lenc, Ladislav
Král, Pavel
author_facet Tran, Václav
Šmíd, Jakub
Martínek, Jiří
Lenc, Ladislav
Král, Pavel
contents Text summarization is the task of shortening a larger body of text into a concise version while retaining its essential meaning and key information. While summarization has been significantly explored in English and other high-resource languages, Czech text summarization, particularly for historical documents, remains underexplored due to linguistic complexities and a scarcity of annotated datasets. Large language models such as Mistral and mT5 have demonstrated excellent results on many natural language processing tasks and languages. Therefore, we employ these models for Czech summarization, resulting in two key contributions: (1) achieving new state-of-the-art results on the modern Czech summarization dataset SumeCzech using these advanced models, and (2) introducing a novel dataset called Posel od Čerchova for summarization of historical Czech documents with baseline results. Together, these contributions provide a great potential for advancing Czech text summarization and open new avenues for research in Czech historical text processing.
format Preprint
id arxiv_https___arxiv_org_abs_2508_10368
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Large Language Models for Summarizing Czech Historical Documents and Beyond
Tran, Václav
Šmíd, Jakub
Martínek, Jiří
Lenc, Ladislav
Král, Pavel
Computation and Language
Text summarization is the task of shortening a larger body of text into a concise version while retaining its essential meaning and key information. While summarization has been significantly explored in English and other high-resource languages, Czech text summarization, particularly for historical documents, remains underexplored due to linguistic complexities and a scarcity of annotated datasets. Large language models such as Mistral and mT5 have demonstrated excellent results on many natural language processing tasks and languages. Therefore, we employ these models for Czech summarization, resulting in two key contributions: (1) achieving new state-of-the-art results on the modern Czech summarization dataset SumeCzech using these advanced models, and (2) introducing a novel dataset called Posel od Čerchova for summarization of historical Czech documents with baseline results. Together, these contributions provide a great potential for advancing Czech text summarization and open new avenues for research in Czech historical text processing.
title Large Language Models for Summarizing Czech Historical Documents and Beyond
topic Computation and Language
url https://arxiv.org/abs/2508.10368