Bangla Key2Text: Text Generation from Keywords for a Low Resource Language

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Talukder, Tonmoy, Shahariar, G M
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910153767387136
author Talukder, Tonmoy
Shahariar, G M
author_facet Talukder, Tonmoy
Shahariar, G M
contents This paper introduces \textit{Bangla Key2Text}, a large-scale dataset of $2.6$ million Bangla keyword--text pairs designed for keyword-driven text generation in a low-resource language. The dataset is constructed using a BERT-based keyword extraction pipeline applied to millions of Bangla news texts, transforming raw articles into structured keyword--text pairs suitable for supervised learning. To establish baseline performance on this new benchmark, we fine-tune two sequence-to-sequence models, \texttt{mT5} and \texttt{BanglaT5}, and evaluate them using multiple automatic metrics and human judgments. Experimental results show that task-specific fine-tuning substantially improves keyword-conditioned text generation in Bangla compared to zero-shot large language models. The dataset, trained models, and code are publicly released to support future research in Bangla natural language generation and keyword-to-text generation tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2604_19508
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Bangla Key2Text: Text Generation from Keywords for a Low Resource Language
Talukder, Tonmoy
Shahariar, G M
Computation and Language
This paper introduces \textit{Bangla Key2Text}, a large-scale dataset of $2.6$ million Bangla keyword--text pairs designed for keyword-driven text generation in a low-resource language. The dataset is constructed using a BERT-based keyword extraction pipeline applied to millions of Bangla news texts, transforming raw articles into structured keyword--text pairs suitable for supervised learning. To establish baseline performance on this new benchmark, we fine-tune two sequence-to-sequence models, \texttt{mT5} and \texttt{BanglaT5}, and evaluate them using multiple automatic metrics and human judgments. Experimental results show that task-specific fine-tuning substantially improves keyword-conditioned text generation in Bangla compared to zero-shot large language models. The dataset, trained models, and code are publicly released to support future research in Bangla natural language generation and keyword-to-text generation tasks.
title Bangla Key2Text: Text Generation from Keywords for a Low Resource Language
topic Computation and Language
url https://arxiv.org/abs/2604.19508