Cover Image

EuroBERT: Scaling Multilingual Encoders for European Languages

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Boizard, Nicolas, Gisserot-Boukhlef, Hippolyte, Alves, Duarte M., Martins, André, Hammal, Ayoub, Corro, Caio, Hudelot, Céline, Malherbe, Emmanuel, Malaboeuf, Etienne, Jourdan, Fanny, Hautreux, Gabriel, Alves, João, Haddad, Kevin El, Faysse, Manuel, Peyrard, Maxime, Guerreiro, Nuno M., Fernandes, Patrick, Rei, Ricardo, Colombo, Pierre
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

BERT-as-a-Judge: A Robust Alternative to Lexical Methods for Efficient Reference-Based LLM Evaluation
by: Gisserot-Boukhlef, Hippolyte, et al.
Published: (2026)

Towards Trustworthy Reranking: A Simple yet Effective Abstention Mechanism
by: Gisserot-Boukhlef, Hippolyte, et al.
Published: (2024)

When Does Reasoning Matter? A Controlled Study of Reasoning's Contribution to Model Performance
by: Boizard, Nicolas, et al.
Published: (2025)

Should We Still Pretrain Encoders with Masked Language Modeling?
by: Gisserot-Boukhlef, Hippolyte, et al.
Published: (2025)

Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysis
by: Gisserot-Boukhlef, Hippolyte, et al.
Published: (2024)

BidirLM: From Text to Omnimodal Bidirectional Encoders by Adapting and Composing Causal LLMs
by: Boizard, Nicolas, et al.
Published: (2026)

On the Rejection Criterion for Proxy-based Test-time Alignment
by: Hammal, Ayoub, et al.
Published: (2026)

Few-Shot Domain Adaptation for Named-Entity Recognition via Joint Constrained k-Means and Subspace Selection
by: Hammal, Ayoub, et al.
Published: (2024)

Suffix-Constrained Greedy Search Algorithms for Causal Language Models
by: Hammal, Ayoub, et al.
Published: (2026)

Kad: A Framework for Proxy-based Test-time Alignment with Knapsack Approximation Deferral
by: Hammal, Ayoub, et al.
Published: (2025)

EuroLLM-22B: Technical Report
by: Ramos, Miguel Moura, et al.
Published: (2026)

Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMs
by: Boizard, Nicolas, et al.
Published: (2024)

CroissantLLM: A Truly Bilingual French-English Language Model
by: Faysse, Manuel, et al.
Published: (2024)

EuroLLM-9B: Technical Report
by: Martins, Pedro Henrique, et al.
Published: (2025)

Revisiting Anisotropy in Language Transformers: The Geometry of Learning Dynamics
by: Bernas, Raphael, et al.
Published: (2026)

EuroLLM: Multilingual Language Models for Europe
by: Martins, Pedro Henrique, et al.
Published: (2024)

Context is Gold to find the Gold Passage: Evaluating and Training Contextual Document Embeddings
by: Conti, Max, et al.
Published: (2025)

ColPali: Efficient Document Retrieval with Vision Language Models
by: Faysse, Manuel, et al.
Published: (2024)

A fast and sound tagging method for discontinuous named-entity recognition
by: Corro, Caio
Published: (2024)

SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain
by: Colombo, Pierre, et al.
Published: (2024)

Advancing Fairness in Natural Language Processing: From Traditional Methods to Explainability
by: Jourdan, Fanny
Published: (2024)

DocPolarBERT: A Pre-trained Model for Document Understanding with Relative Polar Coordinate Encoding of Layout Structures
by: Uthayasooriyar, Benno, et al.
Published: (2025)

ConceptGuard: Neuro-Symbolic Safety Guardrails via Sparse Interpretable Jailbreak Concepts
by: Aswal, Darpan, et al.
Published: (2025)

Sparse Logistic Regression with High-order Features for Automatic Grammar Rule Extraction from Treebanks
by: Herrera, Santiago, et al.
Published: (2024)

FairTranslate: An English-French Dataset for Gender Bias Evaluation in Machine Translation by Overcoming Gender Binarity
by: Jourdan, Fanny, et al.
Published: (2025)

Interpreto: An Explainability Library for Transformers
by: Poché, Antonin, et al.
Published: (2025)

Bregman Conditional Random Fields: Sequence Labeling with Parallelizable Inference Algorithms
by: Corro, Caio, et al.
Published: (2025)

ViDoRe V3: A Comprehensive Evaluation of Retrieval Augmented Generation in Complex Real-World Scenarios
by: Loison, António, et al.
Published: (2026)

Cylinders' percolation: decoupling and applications
by: Alves, Caio, et al.
Published: (2021)

Exponential Bounds and Analyticity for the Tree Builder Random Walk
by: Alves, Caio, et al.
Published: (2026)

A Complexity Map of Probabilistic Reasoning for Neurosymbolic Classification Techniques
by: Ledaguenel, Arthur, et al.
Published: (2024)

Improving Neural-based Classification with Logical Background Knowledge
by: Ledaguenel, Arthur, et al.
Published: (2024)

Neurosymbolic Conformal Classification
by: Ledaguenel, Arthur, et al.
Published: (2024)

Recommendation of data-free class-incremental learning algorithms by simulating future data
by: Feillet, Eva, et al.
Published: (2024)

A Study on Building Efficient Zero-Shot Relation Extraction Models
by: Thomas, Hugo, et al.
Published: (2026)

Training LayoutLM from Scratch for Efficient Named-Entity Recognition in the Insurance Domain
by: Uthayasooriyar, Benno, et al.
Published: (2024)

Building Solidarity With and Without Community Psychology
by: Nick Malherbe
Published: (2025)

Responsabilidad social de la empresa y fiscalidad
by: Jacques Malherbe
Published: (2013)

Perfil da vítima e características da violência contra a mulher no estado de Rondônia - Brasil
by: Caio Alves Barbosa de Oliveira
Published: (2019)

Data Supporting Figures for: Primordial Gravitational Wave Backgrounds from Phase Transitions with Next Generation Ground Based Detectors
by: Quelquejay, Hippolyte
Published: (2025)