Imagen de Portada

mALBERT: Is a Compact Multilingual BERT Model Still Worth It?

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Servan, Christophe, Ghannay, Sahar, Rosset, Sophie
Formato:	Preprint
Publicado:	2024
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Small Language Models are Good Too: An Empirical Study of Zero-Shot Classification
por: Lepagnol, Pierre, et al.
Publicado: (2024)

New Semantic Task for the French Spoken Language Understanding MEDIA Benchmark
por: Alavoine, Nadège, et al.
Publicado: (2024)

Leveraging Information Retrieval to Enhance Spoken Language Understanding Prompts in Few-Shot Learning
por: Lepagnol, Pierre, et al.
Publicado: (2025)

LLM-based Atomic Propositions help weak extractors: Evaluation of a Propositioner for triplet extraction
por: Pommeret, Luc, et al.
Publicado: (2026)

Do BERT-Like Bidirectional Models Still Perform Better on Text Classification in the Era of LLMs?
por: Zhang, Junyan, et al.
Publicado: (2025)

A Benchmark Evaluation of Clinical Named Entity Recognition in French
por: Bannour, Nesrine, et al.
Publicado: (2024)

EuroBERT: Scaling Multilingual Encoders for European Languages
por: Boizard, Nicolas, et al.
Publicado: (2025)

Languages Still Left Behind: Toward a Better Multilingual Machine Translation Benchmark
por: Taguchi, Chihiro, et al.
Publicado: (2025)

BBPOS: BERT-based Part-of-Speech Tagging for Uzbek
por: Bobojonova, Latofat, et al.
Publicado: (2025)

Bug Destiny Prediction in Large Open-Source Software Repositories through Sentiment Analysis and BERT Topic Modeling
por: Pope, Sophie C., et al.
Publicado: (2025)

PolyBERT: Fine-Tuned Poly Encoder BERT-Based Model for Word Sense Disambiguation
por: Xia, Linhan, et al.
Publicado: (2025)

MrBERT: Modern Multilingual Encoders via Vocabulary, Domain, and Dimensional Adaptation
por: Tamayo, Daniel, et al.
Publicado: (2026)

KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Texts
por: Autenried, Christian, et al.
Publicado: (2026)

KuBERT: Central Kurdish BERT Model and Its Application for Sentiment Analysis
por: Awlla, Kozhin muhealddin, et al.
Publicado: (2025)

mHuBERT-147: A Compact Multilingual HuBERT Model
por: Boito, Marcely Zanon, et al.
Publicado: (2024)

Is Peer-Reviewing Worth the Effort?
por: Church, Kenneth, et al.
Publicado: (2024)

FLUX: Data Worth Training On
por: Gowtham, et al.
Publicado: (2026)

NeoBERT: A Next-Generation BERT
por: Breton, Lola Le, et al.
Publicado: (2025)

FRASIMED: a Clinical French Annotated Resource Produced through Crosslingual BERT-Based Annotation Projection
por: Zaghir, Jamil, et al.
Publicado: (2023)

A Diversity Diet for a Healthier Model: A Case Study of French ModernBERT
por: Estève, Louis, et al.
Publicado: (2026)

Lessons Without Borders? Evaluating Cultural Alignment of LLMs Using Multilingual Story Moral Generation
por: Wu, Sophie, et al.
Publicado: (2026)

BERT4FCA: A Method for Bipartite Link Prediction using Formal Concept Analysis and BERT
por: Peng, Siqi, et al.
Publicado: (2024)

AI Hallucinations: A Misnomer Worth Clarifying
por: Maleki, Negar, et al.
Publicado: (2024)

IM-BERT: Enhancing Robustness of BERT through the Implicit Euler Method
por: Kim, Mihyeon, et al.
Publicado: (2025)

Analyzing Multi-Head Attention on Trojan BERT Models
por: Wang, Jingwei
Publicado: (2024)

How Much is Brain Data Worth for Machine Learning?
por: Lewis, Lane, et al.
Publicado: (2026)

When Remembering and Planning are Worth it: Navigating under Change
por: Madani, Omid, et al.
Publicado: (2026)

LegalPro-BERT: Classification of Legal Provisions by fine-tuning BERT Large Language Model
por: Tewari, Amit
Publicado: (2024)

mR3: Multilingual Rubric-Agnostic Reward Reasoning Models
por: Anugraha, David, et al.
Publicado: (2025)

Neural Architecture Search for Sentence Classification with BERT
por: Kenneweg, Philip, et al.
Publicado: (2024)

Large Language Models Are Still Misled by Simple Bias Ensembles
por: Sun, Zhouhao, et al.
Publicado: (2025)

RooseBERT: A New Deal For Political Language Modelling
por: Dore, Deborah, et al.
Publicado: (2025)

Vision HgNN: An Electron-Micrograph is Worth Hypergraph of Hypernodes
por: Srinivas, Sakhinana Sagar, et al.
Publicado: (2024)

Not All Personas Are Worth It: Culture-Reflective Persona Data Augmentation
por: Han, Ji-Eun, et al.
Publicado: (2025)

Patent Language Model Pretraining with ModernBERT
por: Yousefiramandi, Amirhossein, et al.
Publicado: (2025)

Understanding Wikidata Qualifiers: An Analysis and Taxonomy
por: Falquet, Gilles, et al.
Publicado: (2026)

How Many Human Survey Respondents is a Large Language Model Worth? An Uncertainty Quantification Perspective
por: Huang, Chengpiao, et al.
Publicado: (2025)

m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt
por: Yang, Jian, et al.
Publicado: (2024)

A Time Series is Worth Five Experts: Heterogeneous Mixture of Experts for Traffic Flow Prediction
por: Wang, Guangyu, et al.
Publicado: (2024)

SMART: When is it Actually Worth Expanding a Speculative Tree?
por: Wang, Lifu, et al.
Publicado: (2026)