Cover Image

NusaBERT: Teaching IndoBERT to be Multilingual and Multicultural

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wongso, Wilson, Setiawan, David Samuel, Limcorn, Steven, Joyoadikusumo, Ananto
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Leveraging IndoBERT and DistilBERT for Indonesian Emotion Classification in E-Commerce Reviews
by: Christian, William, et al.
Published: (2025)

IndoBERT-Sentiment: Context-Conditioned Sentiment Classification for Indonesian Text
by: Saputra, Muhammad Apriandito Arya, et al.
Published: (2026)

IndoBERT-Relevancy: A Context-Conditioned Relevancy Classifier for Indonesian Text
by: Saputra, Muhammad Apriandito Arya, et al.
Published: (2026)

Benchmarking Logistic Regression, SVM, Naive Bayes, and IndoBERT Fine-Tuning for Sentiment Analysis on Indonesian Product Reviews
by: Zahra, Nabila Zakiyah, et al.
Published: (2026)

Benchmarking PyCaret AutoML Against IndoBERT Fine-Tuning for Sentiment Analysis on Indonesian IKN Twitter Data
by: Mayzaroh, Mutia Alfi, et al.
Published: (2026)

GPT or BERT: why not both?
by: Charpentier, Lucas Georges Gabriel, et al.
Published: (2024)

Dependency Annotation of Ottoman Turkish with Multilingual BERT
by: Özateş, Şaziye Betül, et al.
Published: (2024)

SwissBERT: The Multilingual Language Model for Switzerland
by: Vamvas, Jannis, et al.
Published: (2023)

mHuBERT-147: A Compact Multilingual HuBERT Model
by: Boito, Marcely Zanon, et al.
Published: (2024)

Sentiment Analysis of User Feedback on Halodoc: Comparative Evaluation of SVM and IndoBERT Models
by: Nouvaldy, Muhammad Rafi, et al.
Published: (2025)

BERT Learns (and Teaches) Chemistry
by: Payne, Josh, et al.
Published: (2020)

Multilingual JobBERT for Cross-Lingual Job Title Matching
by: Decorte, Jens-Joris, et al.
Published: (2025)

EuroBERT: Scaling Multilingual Encoders for European Languages
by: Boizard, Nicolas, et al.
Published: (2025)

FaBERT: Pre-training BERT on Persian Blogs
by: Masumi, Mostafa, et al.
Published: (2024)

NeoBERT: A Next-Generation BERT
by: Breton, Lola Le, et al.
Published: (2025)

NeoDictaBERT: Pushing the Frontier of BERT models for Hebrew
by: Shmidman, Shaltiel, et al.
Published: (2025)

QiBERT -- Classifying Online Conversations Messages with BERT as a Feature
by: Ferreira-Saraiva, Bruno D., et al.
Published: (2024)

Pre-training technique to localize medical BERT and enhance biomedical BERT
by: Wada, Shoya, et al.
Published: (2020)

An investigation of structures responsible for gender bias in BERT and DistilBERT
by: Leteno, Thibaud, et al.
Published: (2024)

SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation
by: Lv, Changze, et al.
Published: (2023)

ACL: Aligned Contrastive Learning Improves BERT and Multi-exit BERT Fine-tuning
by: Li, Liz, et al.
Published: (2026)

InvBERT: Reconstructing Text from Contextualized Word Embeddings by inverting the BERT pipeline
by: Kugler, Kai, et al.
Published: (2021)

Multilingual Clinical NER for Diseases and Medications Recognition in Cardiology Texts using BERT Embeddings
by: Danu, Manuela Daniela, et al.
Published: (2025)

IM-BERT: Enhancing Robustness of BERT through the Implicit Euler Method
by: Kim, Mihyeon, et al.
Published: (2025)

KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Texts
by: Autenried, Christian, et al.
Published: (2026)

BERT-LID: Leveraging BERT to Improve Spoken Language Identification
by: Nie, Yuting, et al.
Published: (2022)

mmBERT: A Modern Multilingual Encoder with Annealed Language Learning
by: Marone, Marc, et al.
Published: (2025)

ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
by: Chaffin, Antoine, et al.
Published: (2026)

KuBERT: Central Kurdish BERT Model and Its Application for Sentiment Analysis
by: Awlla, Kozhin muhealddin, et al.
Published: (2025)

Attention on Multiword Expressions: A Multilingual Study of BERT-based Models with Regard to Idiomaticity and Microsyntax
by: Zaitova, Iuliia, et al.
Published: (2025)

Multilingual BERT language model for medical tasks: Evaluation on domain-specific adaptation and cross-linguality
by: Luo, Yinghao, et al.
Published: (2025)

How Much Noise Can BERT Handle? Insights from Multilingual Sentence Difficulty Detection
by: Khallaf, Nouran, et al.
Published: (2026)

TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkish
by: Türker, Melikşah, et al.
Published: (2025)

DE$^3$-BERT: Distance-Enhanced Early Exiting for BERT based on Prototypical Networks
by: He, Jianing, et al.
Published: (2024)

MaxPoolBERT: Enhancing BERT Classification via Layer- and Token-Wise Aggregation
by: Behrendt, Maike, et al.
Published: (2025)

DunbaaBERT: From Sacrifice to Semantics
by: Maab, Iffat, et al.
Published: (2026)

Morphosyntactic probing of multilingual BERT models
by: Acs, Judit, et al.
Published: (2023)

Probing BERT for German Compound Semantics
by: Miletić, Filip, et al.
Published: (2025)

MrBERT: Modern Multilingual Encoders via Vocabulary, Domain, and Dimensional Adaptation
by: Tamayo, Daniel, et al.
Published: (2026)

ModernBERT is More Efficient than Conventional BERT for Chest CT Findings Classification in Japanese Radiology Reports
by: Yamagishi, Yosuke, et al.
Published: (2025)