Cover Image

DunbaaBERT: From Sacrifice to Semantics

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Maab, Iffat, Jamil, Waleed, Schmitt, Raphael
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

When Bigger Isn't Better: A Comprehensive Fairness Evaluation of Political Bias in Multi-News Summarisation
by: Huang, Nannan, et al.
Published: (2026)

Investigating Thinking Behaviours of Reasoning-Based Language Models for Social Bias Mitigation
by: Luo, Guoqing, et al.
Published: (2025)

Towards Automated Fact-Checking of Real-World Claims: Exploring Task Formulation and Assessment with LLMs
by: Sahitaj, Premtim, et al.
Published: (2025)

HalleluBERT: Let Every Token That Has Meaning Bear Its Weight
by: Schmitt, Raphael
Published: (2025)

From Articles to Premises: Building PrimeFacts, an Extraction Methodology and Resource for Fact-Checking Evidence
by: Sahitaj, Premtim, et al.
Published: (2026)

SindBERT, the Sailor: Charting the Seas of Turkish NLP
by: Schmitt, Raphael, et al.
Published: (2025)

GeistBERT: Breathing Life into German NLP
by: Scheible-Schmitt, Raphael, et al.
Published: (2025)

Probing BERT for German Compound Semantics
by: Miletić, Filip, et al.
Published: (2025)

Semantic and Contextual Modeling for Malicious Comment Detection with BERT-BiLSTM
by: Fang, Zhou, et al.
Published: (2025)

(Chat)GPT v BERT: Dawn of Justice for Semantic Change Detection
by: Periti, Francesco, et al.
Published: (2024)

FaBERT: Pre-training BERT on Persian Blogs
by: Masumi, Mostafa, et al.
Published: (2024)

NusaBERT: Teaching IndoBERT to be Multilingual and Multicultural
by: Wongso, Wilson, et al.
Published: (2024)

From BERT to T5: A Study of Named Entity Recognition
by: Jia, Mei
Published: (2026)

FRASIMED: a Clinical French Annotated Resource Produced through Crosslingual BERT-Based Annotation Projection
by: Zaghir, Jamil, et al.
Published: (2023)

Semantic similarity estimation for domain specific data using BERT and other techniques
by: Prashanth, R.
Published: (2025)

NeoDictaBERT: Pushing the Frontier of BERT models for Hebrew
by: Shmidman, Shaltiel, et al.
Published: (2025)

Scaling HuBERT for African Languages: From Base to Large and XL
by: Caubrière, Antoine, et al.
Published: (2025)

QiBERT -- Classifying Online Conversations Messages with BERT as a Feature
by: Ferreira-Saraiva, Bruno D., et al.
Published: (2024)

Pre-training technique to localize medical BERT and enhance biomedical BERT
by: Wada, Shoya, et al.
Published: (2020)

GottBERT: a pure German Language Model
by: Scheible, Raphael, et al.
Published: (2020)

From BERT to Qwen: Hate Detection across architectures
by: Mon, Ariadna, et al.
Published: (2025)

BERT-JEPA: Reorganizing CLS Embeddings for Language-Invariant Semantics
by: Gillin, Taj, et al.
Published: (2026)

NeoBERT: A Next-Generation BERT
by: Breton, Lola Le, et al.
Published: (2025)

SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation
by: Lv, Changze, et al.
Published: (2023)

From BERT to LLMs: Comparing and Understanding Chinese Classifier Prediction in Language Models
by: Zhang, Ziqi, et al.
Published: (2025)

ACL: Aligned Contrastive Learning Improves BERT and Multi-exit BERT Fine-tuning
by: Li, Liz, et al.
Published: (2026)

InvBERT: Reconstructing Text from Contextualized Word Embeddings by inverting the BERT pipeline
by: Kugler, Kai, et al.
Published: (2021)

Leveraging IndoBERT and DistilBERT for Indonesian Emotion Classification in E-Commerce Reviews
by: Christian, William, et al.
Published: (2025)

An investigation of structures responsible for gender bias in BERT and DistilBERT
by: Leteno, Thibaud, et al.
Published: (2024)

GPT or BERT: why not both?
by: Charpentier, Lucas Georges Gabriel, et al.
Published: (2024)

Gazetteer-Enhanced Bangla Named Entity Recognition with BanglaBERT Semantic Embeddings K-Means-Infused CRF Model
by: Farhan, Niloy, et al.
Published: (2024)

A Study on How Attention Scores in the BERT Model are Aware of Lexical Categories in Syntactic and Semantic Tasks on the GLUE Benchmark
by: Jang, Dongjun, et al.
Published: (2024)

AFRIDOC-MT: Document-level MT Corpus for African Languages
by: Alabi, Jesujoba O., et al.
Published: (2025)

TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkish
by: Türker, Melikşah, et al.
Published: (2025)

A Comprehensive Survey of Sentence Representations: From the BERT Epoch to the ChatGPT Era and Beyond
by: Kashyap, Abhinav Ramesh, et al.
Published: (2023)

How Similar Are Elected Politicians and Their Constituents? Quantitative Evidence From Online Social Networks
by: Iqbal, Waleed, et al.
Published: (2024)

KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Texts
by: Autenried, Christian, et al.
Published: (2026)

IM-BERT: Enhancing Robustness of BERT through the Implicit Euler Method
by: Kim, Mihyeon, et al.
Published: (2025)

Morphosyntactic probing of multilingual BERT models
by: Acs, Judit, et al.
Published: (2023)

ModernBERT is More Efficient than Conventional BERT for Chest CT Findings Classification in Japanese Radiology Reports
by: Yamagishi, Yosuke, et al.
Published: (2025)