Cover Image

NorBERTo: A ModernBERT Model Trained for Portuguese with 331 Billion Tokens Corpus

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Silva, Enzo S. N., Costa, Pablo B., Vlasman, Raphael C., Costa, Rosimeire P., Silva, Henrique L. P., Pellicer, Lucas F. A. O., Rinaldo, Guilherme, Almeida, Renato A., Rabbani, Darian S. R., Oestreich, Cinthya O., Caridá, Vinicius F.
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Patent Language Model Pretraining with ModernBERT
by: Yousefiramandi, Amirhossein, et al.
Published: (2025)

Chinese ModernBERT with Whole-Word Masking
by: Zhao, Zeyu, et al.
Published: (2025)

Clinical ModernBERT: An efficient and long context encoder for biomedical text
by: Lee, Simon A., et al.
Published: (2025)

ModernBERT + ColBERT: Enhancing biomedical RAG through an advanced re-ranking retriever
by: Rivera, Eduardo Martínez, et al.
Published: (2025)

llm-jp-modernbert: A ModernBERT Model Trained on a Large-Scale Japanese Corpus with Long Context Length
by: Sugiura, Issa, et al.
Published: (2025)

TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkish
by: Türker, Melikşah, et al.
Published: (2025)

ModernBERT is More Efficient than Conventional BERT for Chest CT Findings Classification in Japanese Radiology Reports
by: Yamagishi, Yosuke, et al.
Published: (2025)

Pretraining Finnish ModernBERTs
by: Reunamo, Akseli, et al.
Published: (2025)

A Diversity Diet for a Healthier Model: A Case Study of French ModernBERT
by: Estève, Louis, et al.
Published: (2026)

Filter-then-Verify: A Multiphase GNN and ModernBERT Framework for Social Engineering Detection in Email Networks
by: Khadka, Barsat, et al.
Published: (2026)

BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLP
by: Sounack, Thomas, et al.
Published: (2025)

Spatial ModernBERT: Spatial-Aware Transformer for Table and Key-Value Extraction in Financial Documents at Scale
by: Javis AI Team, et al.
Published: (2025)

A Infância No Cinema De Abbas Kiarostami
by: Darian Soheil Rahnamaye Rabbani
Published: (2019)

ModernBERT or DeBERTaV3? Examining Architecture and Data Influence on Transformer Encoder Models Performance
by: Antoun, Wissam, et al.
Published: (2025)

Comparative Analysis of Lion and AdamW Optimizers for Cross-Encoder Reranking with MiniLM, GTE, and ModernBERT
by: Kumar, Shahil, et al.
Published: (2025)

Is There Yardstick Competition among Portuguese Municipalities?
by: José Silva Costa
Published: (2011)

Manner-Path English-Portuguese (Written Elicitation)
by: Costa-Silva, Jean
Published: (2025)

Developing an ESG-Oriented Large Language Model through ESG Practices
by: Assis, Gabriel, et al.
Published: (2026)

Wainwright and Kwan: Neither Relativism Nor Exclusivism
by: Anthony O'Hear
Published: (2025)

Emissionsreduzierung in der chemischen Industrie
by: Volker Oestreich
Published: (2025)

OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
by: Li, Qingyun, et al.
Published: (2024)

Colonial Brazilian Portuguese: a new research agenda between Classical Portuguese and Modern Brazilian Portuguese
by: Cardoso, Lara da Silva, et al.
Published: (2021)

México, el derrumbe de un régimen y la política exterior
by: Olga Pellicer Silva
Published: (2019)

Transparent reporting of studies relevant to physical therapy practice
by: Leonardo O. P. Costa
Published: (2011)

Endorsement of trial registration and the CONSORT statement by the Revista Brasileira de Fisioterapia
by: Leonardo O. P. Costa
Published: (2010)

Clinical trial registration in physical therapy journals: recommendations from the International Society of Physiotherapy Journal Editors
by: Leonardo O. P. Costa
Published: (2012)

MathPile: A Billion-Token-Scale Pretraining Corpus for Math
by: Wang, Zengzhi, et al.
Published: (2023)

Ex-Chair of Portuguese Chapter awarded by EdSoc
by: Costa, Anikó
Published: (2024)

GiusBERTo: A Legal Language Model for Personal Data De-identification in Italian Court of Auditors Decisions
by: Salierno, Giulio, et al.
Published: (2024)

Metapesquisa no campo da Política Educacional
by: Paula Cinthya Silva Cintra
Published: (2023)

The Southeast Asian Bronze Age Fringe? Technological, Elemental and Lead Isotopic Data From Nong Nor and Koh Ta Méas
by: T. O. Pryce, et al.
Published: (2026)

Layer-wise LoRA fine-tuning: a similarity metric approach
by: Ogawa, Keith Ando, et al.
Published: (2026)

Clinical named entity recognition in the Portuguese language: a benchmark of modern BERT models and LLMs
by: de Almeida, Vinicius Anjos, et al.
Published: (2026)

SoftMatcha: A Soft and Fast Pattern Matcher for Billion-Scale Corpus Searches
by: Deguchi, Hiroyuki, et al.
Published: (2025)

Silylium‐Ion‐Initiated Disulfidation of Internal Alkynes With Disulfides
by: Dáiríne M. Morgan, et al.
Published: (2026)

Evaluating Structured Decoding for Text-to-Table Generation: Evidence from Three Datasets
by: Oestreich, Julian, et al.
Published: (2025)

Directing Effects of Silyl and Germyl Groups in Transition‐Metal‐Catalyzed Allylic Substitution
by: Daniel Brösamlen, et al.
Published: (2025)

The work ability index and functional capacity among older workers
by: Rosimeire S. Padula
Published: (2013)

Análise da apresentação textual de revisões sistemáticas em fisioterapia publicadas no idioma português
by: Rosimeire S. Padula
Published: (2012)

Physical therapy in occupational health and ergonomics: practical applications and innovative research approaches
by: Rosimeire S. Padula
Published: (2016)