Cover Image

Distilling Monolingual and Crosslingual Word-in-Context Representations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Arase, Yuki, Kajiwara, Tomoyuki
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Edit-Constrained Decoding for Sentence Simplification
by: Zetsu, Tatsuya, et al.
Published: (2024)

An In-depth Evaluation of Large Language Models in Sentence Simplification with Error-based Human Assessment
by: Wu, Xuanxin, et al.
Published: (2024)

Hallucinated Span Detection with Multi-View Attention Features
by: Ogasa, Yuya, et al.
Published: (2025)

Aligning Sentence Simplification with ESL Learner's Proficiency for Language Acquisition
by: Li, Guanlin, et al.
Published: (2025)

MoSECroT: Model Stitching with Static Word Embeddings for Crosslingual Zero-shot Transfer
by: Ye, Haotian, et al.
Published: (2024)

Post-Training Language Models for Crosslingual Consistency
by: Liu, Tianyu, et al.
Published: (2026)

Static Word Embeddings for Sentence Semantic Representation
by: Wada, Takashi, et al.
Published: (2025)

Bilingual Adaptation of Monolingual Foundation Models
by: Gosal, Gurpreet, et al.
Published: (2024)

Crosslingual Reasoning through Test-Time Scaling
by: Yong, Zheng-Xin, et al.
Published: (2025)

Introducing cosmosGPT: Monolingual Training for Turkish Language Models
by: Kesgin, H. Toprak, et al.
Published: (2024)

Towards Better Monolingual Japanese Retrievers with Multi-Vector Models
by: Clavié, Benjamin
Published: (2023)

Investigating Idiomaticity in Word Representations
by: He, Wei, et al.
Published: (2024)

Boosting Zero-Shot Crosslingual Performance using LLM-Based Augmentations with Effective Data Selection
by: Fazili, Barah, et al.
Published: (2024)

The Scandinavian Embedding Benchmarks: Comprehensive Assessment of Multilingual and Monolingual Text Embedding
by: Enevoldsen, Kenneth, et al.
Published: (2024)

UrduLM: A Resource-Efficient Monolingual Urdu Language Model
by: Ali, Syed Muhammad, et al.
Published: (2026)

Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca
by: Chen, Pinzhen, et al.
Published: (2023)

Exploring Linguistic Properties of Monolingual BERTs with Typological Classification among Languages
by: Ruzzetti, Elena Sofia, et al.
Published: (2023)

FRASIMED: a Clinical French Annotated Resource Produced through Crosslingual BERT-Based Annotation Projection
by: Zaghir, Jamil, et al.
Published: (2023)

Using Images to Find Context-Independent Word Representations in Vector Space
by: Kumar, Harsh
Published: (2024)

Comparing Explanation Faithfulness between Multilingual and Monolingual Fine-tuned Language Models
by: Zhao, Zhixue, et al.
Published: (2024)

Mitigating Stylistic Biases of Machine Translation Systems via Monolingual Corpora Only
by: Gao, Xuanqi, et al.
Published: (2025)

Meta4XNLI: A Crosslingual Parallel Corpus for Metaphor Detection and Interpretation
by: Sanchez-Bayona, Elisa, et al.
Published: (2024)

Multilingual Information Retrieval with a Monolingual Knowledge Base
by: Zhuang, Yingying, et al.
Published: (2025)

Paramanu: Compact and Competitive Monolingual Language Models for Low-Resource Morphologically Rich Indian Languages
by: Niyogi, Mitodru, et al.
Published: (2024)

Evaluating Monolingual and Multilingual Large Language Models for Greek Question Answering: The DemosQA Benchmark
by: Mastrokostas, Charalampos, et al.
Published: (2026)

MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talks
by: Papi, Sara, et al.
Published: (2025)

N-gram Prediction and Word Difference Representations for Language Modeling
by: Heo, DongNyeong, et al.
Published: (2024)

A Diversity-Enhanced Knowledge Distillation Model for Practical Math Word Problem Solving
by: Zhang, Yi, et al.
Published: (2025)

Words that make SENSE: Sensorimotor Norms in Learned Lexical Token Representations
by: Gupta, Abhinav, et al.
Published: (2026)

SANDWiCH: Semantical Analysis of Neighbours for Disambiguating Words in Context ad Hoc
by: Guzman-Olivares, Daniel, et al.
Published: (2025)

LAGO: Few-shot Crosslingual Embedding Inversion Attacks via Language Similarity-Aware Graph Optimization
by: Yu, Wenrui, et al.
Published: (2025)

OPSDL: On-Policy Self-Distillation for Long-Context Language Models
by: Zhang, Xinsen, et al.
Published: (2026)

Whispering Context: Distilling Syntax and Semantics for Long Speech Transcripts
by: Altinok, Duygu
Published: (2025)

KV-Distill: Nearly Lossless Learnable Context Compression for LLMs
by: Chari, Vivek, et al.
Published: (2025)

fact check AI at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-checked Claim Retrieval
by: Rastogi, Pranshu
Published: (2025)

Pronunciation-Lexicon Free Training for Phoneme-based Crosslingual ASR via Joint Stochastic Approximation
by: Yusuyin, Saierdaer, et al.
Published: (2025)

Sensory-Aware Sequential Recommendation via Review-Distilled Representations
by: Yoon, Yeo Chan, et al.
Published: (2026)

From Deferral to Learning: Online In-Context Knowledge Distillation for LLM Cascades
by: Wu, Yu, et al.
Published: (2025)

Updating Parametric Knowledge with Context Distillation Retains Post-Training Capabilities
by: Padmanabhan, Shankar, et al.
Published: (2026)

Rapid Word Learning Through Meta In-Context Learning
by: Wang, Wentao, et al.
Published: (2025)