IndoBERT-Relevancy: A Context-Conditioned Relevancy Classifier for Indonesian Text
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911547966619648 |
|---|---|
| author | Saputra, Muhammad Apriandito Arya Alamsyah, Andry Ramadhani, Dian Puteri Siadari, Thomhert Suprapto Fakhrurroja, Hanif |
| author_facet | Saputra, Muhammad Apriandito Arya Alamsyah, Andry Ramadhani, Dian Puteri Siadari, Thomhert Suprapto Fakhrurroja, Hanif |
| contents | Determining whether a piece of text is relevant to a given topic is a fundamental task in natural language processing, yet it remains largely unexplored for Bahasa Indonesia. Unlike sentiment analysis or named entity recognition, relevancy classification requires the model to reason about the relationship between two inputs simultaneously: a topical context and a candidate text. We introduce IndoBERT-Relevancy, a context-conditioned relevancy classifier built on IndoBERT Large (335M parameters) and trained on a novel dataset of 31,360 labeled pairs spanning 188 topics. Through an iterative, failure-driven data construction process, we demonstrate that no single data source is sufficient for robust relevancy classification, and that targeted synthetic data can effectively address specific model weaknesses. Our final model achieves an F1 score of 0.948 and an accuracy of 96.5%, handling both formal and informal Indonesian text. The model is publicly available at HuggingFace. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_26095 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | IndoBERT-Relevancy: A Context-Conditioned Relevancy Classifier for Indonesian Text Saputra, Muhammad Apriandito Arya Alamsyah, Andry Ramadhani, Dian Puteri Siadari, Thomhert Suprapto Fakhrurroja, Hanif Computation and Language 68T50 I.2.7; H.3.3 Determining whether a piece of text is relevant to a given topic is a fundamental task in natural language processing, yet it remains largely unexplored for Bahasa Indonesia. Unlike sentiment analysis or named entity recognition, relevancy classification requires the model to reason about the relationship between two inputs simultaneously: a topical context and a candidate text. We introduce IndoBERT-Relevancy, a context-conditioned relevancy classifier built on IndoBERT Large (335M parameters) and trained on a novel dataset of 31,360 labeled pairs spanning 188 topics. Through an iterative, failure-driven data construction process, we demonstrate that no single data source is sufficient for robust relevancy classification, and that targeted synthetic data can effectively address specific model weaknesses. Our final model achieves an F1 score of 0.948 and an accuracy of 96.5%, handling both formal and informal Indonesian text. The model is publicly available at HuggingFace. |
| title | IndoBERT-Relevancy: A Context-Conditioned Relevancy Classifier for Indonesian Text |
| topic | Computation and Language 68T50 I.2.7; H.3.3 |
| url | https://arxiv.org/abs/2603.26095 |