Pretraining Language Models with Subword Regularization: An Empirical Study of BPE Dropout in Low-Resource NLP

Documenti analoghi

• Combining Language and Topic Models for Hierarchical Text Classification
  di: Toit, Jaco du, et al.
  Pubblicazione: (2025)
• SuperBPE: Space Travel for Language Models
  di: Liu, Alisa, et al.
  Pubblicazione: (2025)
• Morphological Typology in BPE Subword Productivity and Language Modeling
  di: Parra, Iñigo
  Pubblicazione: (2024)
• Understanding Subword Compositionality of Large Language Models
  di: Peng, Qiwei, et al.
  Pubblicazione: (2025)
• On Importance of Pruning and Distillation for Efficient Low Resource NLP
  di: Mirashi, Aishwarya, et al.
  Pubblicazione: (2024)