Imagen de Portada

FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Dobler, Konstantin, de Melo, Gerard
Formato:	Preprint
Publicado:	2023
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Token Distillation: Attention-aware Input Embeddings For New Tokens
por: Dobler, Konstantin, et al.
Publicado: (2025)

Language Adaptation on a Tight Academic Compute Budget: Tokenizer Swapping Works and Pure bfloat16 Is Enough
por: Dobler, Konstantin, et al.
Publicado: (2024)

I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Token
por: Cohen, Roi, et al.
Publicado: (2024)

The Scandinavian Embedding Benchmarks: Comprehensive Assessment of Multilingual and Monolingual Text Embedding
por: Enevoldsen, Kenneth, et al.
Publicado: (2024)

Multilingual Reasoning Gym: Multilingual Scaling of Procedural Reasoning Environments
por: Dobler, Konstantin, et al.
Publicado: (2026)

mAceReason-Math: A Dataset of High-Quality Multilingual Math Problems Ready For RLVR
por: Dobler, Konstantin, et al.
Publicado: (2026)

When Does Monolingual Data Help Multilingual Translation: The Role of Domain and Model Scale
por: Baziotis, Christos, et al.
Publicado: (2023)

Comparing Explanation Faithfulness between Multilingual and Monolingual Fine-tuned Language Models
por: Zhao, Zhixue, et al.
Publicado: (2024)

Multilingual Information Retrieval with a Monolingual Knowledge Base
por: Zhuang, Yingying, et al.
Publicado: (2025)

Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Survey
por: Wang, Xinyu, et al.
Publicado: (2024)

Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca
por: Chen, Pinzhen, et al.
Publicado: (2023)

Evaluating Monolingual and Multilingual Large Language Models for Greek Question Answering: The DemosQA Benchmark
por: Mastrokostas, Charalampos, et al.
Publicado: (2026)

Synergistic Approach for Simultaneous Optimization of Monolingual, Cross-lingual, and Multilingual Information Retrieval
por: Elmahdy, Adel, et al.
Publicado: (2024)

Claim Detection for Automated Fact-checking: A Survey on Monolingual, Multilingual and Cross-Lingual Research
por: Panchendrarajan, Rrubaa, et al.
Publicado: (2024)

Goldfish: Monolingual Language Models for 350 Languages
por: Chang, Tyler A., et al.
Publicado: (2024)

EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learning
por: Mao, Zhuoyuan, et al.
Publicado: (2022)

Bilingual Adaptation of Monolingual Foundation Models
por: Gosal, Gurpreet, et al.
Publicado: (2024)

Yankari: A Monolingual Yoruba Dataset
por: Akpobi, Maro
Publicado: (2024)

OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretraining
por: Liu, Yihong, et al.
Publicado: (2023)

Adapting Multilingual Embedding Models to Historical Luxembourgish
por: Michail, Andrianos, et al.
Publicado: (2025)

Efficient Parallelization Layouts for Large-Scale Distributed Model Training
por: Hagemann, Johannes, et al.
Publicado: (2023)

Towards Better Monolingual Japanese Retrievers with Multi-Vector Models
por: Clavié, Benjamin
Publicado: (2023)

Introducing cosmosGPT: Monolingual Training for Turkish Language Models
por: Kesgin, H. Toprak, et al.
Publicado: (2024)

Exploring the Effectiveness of Methods for Persona Extraction
por: Zaitsev, Konstantin
Publicado: (2024)

From Monolingual to Bilingual: Investigating Language Conditioning in Large Language Models for Psycholinguistic Tasks
por: Yuan, Shuzhou, et al.
Publicado: (2025)

Combining Distantly Supervised Models with In Context Learning for Monolingual and Cross-Lingual Relation Extraction
por: Rathore, Vipul, et al.
Publicado: (2025)

Context-Aware Monolingual Human Evaluation of Machine Translation
por: Picinini, Silvio, et al.
Publicado: (2025)

Distilling Monolingual and Crosslingual Word-in-Context Representations
por: Arase, Yuki, et al.
Publicado: (2024)

UrduLM: A Resource-Efficient Monolingual Urdu Language Model
por: Ali, Syed Muhammad, et al.
Publicado: (2026)

Team QUST at SemEval-2024 Task 8: A Comprehensive Study of Monolingual and Multilingual Approaches for Detecting AI-generated Text
por: Xu, Xiaoman, et al.
Publicado: (2024)

Connecting the Dots: What Graph-Based Text Representations Work Best for Text Classification Using Graph Neural Networks?
por: Bugueño, Margarita, et al.
Publicado: (2023)

Rethinking Graph-Based Document Classification: Learning Data-Driven Structures Beyond Heuristic Approaches
por: Bugueño, Margarita, et al.
Publicado: (2025)

Multilingual Test-Time Scaling via Initial Thought Transfer
por: Bajpai, Prasoon, et al.
Publicado: (2025)

Unsupervised Cross-Lingual Part-of-Speech Tagging with Monolingual Corpora Only
por: Zheng, Jianyu
Publicado: (2026)

The Privileged Students: On the Value of Initialization in Multilingual Knowledge Distillation
por: Wibowo, Haryo Akbarianto, et al.
Publicado: (2024)

Pretraining Strategies using Monolingual and Parallel Data for Low-Resource Machine Translation
por: Nguefack, Idriss Nguepi, et al.
Publicado: (2025)

LuxIT: A Luxembourgish Instruction Tuning Dataset from Monolingual Seed Data
por: Valline, Julian, et al.
Publicado: (2025)

HAMLET: Healthcare-focused Adaptive Multilingual Learning Embedding-based Topic Modeling
por: Sakai, Hajar, et al.
Publicado: (2025)

Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalities
por: Sheth, Rajvee, et al.
Publicado: (2025)

TiME: Tiny Monolingual Encoders for Efficient NLP Pipelines
por: Schulmeister, David, et al.
Publicado: (2025)