Saved in:
Bibliographic Details
Main Authors: Ali, Wazir, Noor, Adeeb, Tumrani, Saifullah
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2605.01323
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909029333204992
author Ali, Wazir
Noor, Adeeb
Tumrani, Saifullah
author_facet Ali, Wazir
Noor, Adeeb
Tumrani, Saifullah
contents In this article, we introduce SiNFluD, a novel benchmark dataset for Sindhi figurative language classification. We first collect raw text from various blogs, social media platforms, and literary sources, and subsequently prepare the corpus for annotation. Two native annotators label the data using the Doccano text annotation tool, achieving an inter-annotator agreement of 0.81. We then establish baseline results using 5-fold and 10-fold cross-validation. Finally, we evaluate mBERT, XLM-RoBERTa, and XLM-RoBERTa-XL models, along with SetFit for few-shot fine-tuning of sentence transformers. Among these, the pretrained XLM-RoBERTa-XL achieves the best performance.
format Preprint
id arxiv_https___arxiv_org_abs_2605_01323
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SiNFluD: Creating and Evaluating Figurative Language Dataset for Sindhi
Ali, Wazir
Noor, Adeeb
Tumrani, Saifullah
Computation and Language
Artificial Intelligence
In this article, we introduce SiNFluD, a novel benchmark dataset for Sindhi figurative language classification. We first collect raw text from various blogs, social media platforms, and literary sources, and subsequently prepare the corpus for annotation. Two native annotators label the data using the Doccano text annotation tool, achieving an inter-annotator agreement of 0.81. We then establish baseline results using 5-fold and 10-fold cross-validation. Finally, we evaluate mBERT, XLM-RoBERTa, and XLM-RoBERTa-XL models, along with SetFit for few-shot fine-tuning of sentence transformers. Among these, the pretrained XLM-RoBERTa-XL achieves the best performance.
title SiNFluD: Creating and Evaluating Figurative Language Dataset for Sindhi
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2605.01323