Should We Still Pretrain Encoders with Masked Language Modeling?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gisserot-Boukhlef, Hippolyte, Boizard, Nicolas, Faysse, Manuel, Alves, Duarte M., Malherbe, Emmanuel, Martins, André F. T., Hudelot, Céline, Colombo, Pierre
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2507.00994