Part-of-speech tagging for Nagamese Language using CRF

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shohe, Alovi N, Khiamungam, Chonglio, Angami, Teisovi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917008510025728
author Shohe, Alovi N
Khiamungam, Chonglio
Angami, Teisovi
author_facet Shohe, Alovi N
Khiamungam, Chonglio
Angami, Teisovi
contents This paper investigates part-of-speech tagging, an important task in Natural Language Processing (NLP) for the Nagamese language. The Nagamese language, a.k.a. Naga Pidgin, is an Assamese-lexified Creole language developed primarily as a means of communication in trade between the Nagas and people from Assam in northeast India. A substantial amount of work in part-of-speech-tagging has been done for resource-rich languages like English, Hindi, etc. However, no work has been done in the Nagamese language. To the best of our knowledge, this is the first attempt at part-of-speech tagging for the Nagamese Language. The aim of this work is to identify the part-of-speech for a given sentence in the Nagamese language. An annotated corpus of 16,112 tokens is created and applied machine learning technique known as Conditional Random Fields (CRF). Using CRF, an overall tagging accuracy of 85.70%; precision, recall of 86%, and f1-score of 85% is achieved. Keywords. Nagamese, NLP, part-of-speech, machine learning, CRF.
format Preprint
id arxiv_https___arxiv_org_abs_2509_19343
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Part-of-speech tagging for Nagamese Language using CRF
Shohe, Alovi N
Khiamungam, Chonglio
Angami, Teisovi
Computation and Language
Artificial Intelligence
This paper investigates part-of-speech tagging, an important task in Natural Language Processing (NLP) for the Nagamese language. The Nagamese language, a.k.a. Naga Pidgin, is an Assamese-lexified Creole language developed primarily as a means of communication in trade between the Nagas and people from Assam in northeast India. A substantial amount of work in part-of-speech-tagging has been done for resource-rich languages like English, Hindi, etc. However, no work has been done in the Nagamese language. To the best of our knowledge, this is the first attempt at part-of-speech tagging for the Nagamese Language. The aim of this work is to identify the part-of-speech for a given sentence in the Nagamese language. An annotated corpus of 16,112 tokens is created and applied machine learning technique known as Conditional Random Fields (CRF). Using CRF, an overall tagging accuracy of 85.70%; precision, recall of 86%, and f1-score of 85% is achieved. Keywords. Nagamese, NLP, part-of-speech, machine learning, CRF.
title Part-of-speech tagging for Nagamese Language using CRF
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2509.19343