Cover Image

M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Jianlv, Xiao, Shitao, Zhang, Peitian, Luo, Kun, Lian, Defu, Liu, Zheng
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

C-Pack: Packed Resources For General Chinese Embeddings
by: Xiao, Shitao, et al.
Published: (2023)

Extensible Embedding: A Flexible Multipler For LLM's Context Length
by: Shao, Ninglu, et al.
Published: (2024)

VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval
by: Zhou, Junjie, et al.
Published: (2024)

BGE Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Models
by: Luo, Kun, et al.
Published: (2024)

Flexibly Scaling Large Language Models Contexts Through Extensible Tokenization
by: Shao, Ninglu, et al.
Published: (2024)

Boosting Long-Context Management via Query-Guided Activation Refilling
by: Qian, Hongjin, et al.
Published: (2024)

ReasonEmbed: Enhanced Text Embeddings for Reasoning-Intensive Document Retrieval
by: Chen, Jianlyu, et al.
Published: (2025)

Long Context Compression with Activation Beacon
by: Zhang, Peitian, et al.
Published: (2024)

Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding
by: Liu, Yichen, et al.
Published: (2022)

Cross-Lingual Multi-Hop Knowledge Editing
by: Khandelwal, Aditi, et al.
Published: (2024)

Understanding Privacy Risks of Embeddings Induced by Large Language Models
by: Zhu, Zhihao, et al.
Published: (2024)

MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentation
by: Qian, Hongjin, et al.
Published: (2024)

MGSA: Multi-Granularity Graph Structure Attention for Knowledge Graph-to-Text Generation
by: Wang, Shanshan, et al.
Published: (2024)

Making Text Embedders Few-Shot Learners
by: Li, Chaofan, et al.
Published: (2024)

Low-Resource Multi-Granularity Academic Function Recognition Based on Multiple Prompt Knowledge
by: Liu, Jiawei, et al.
Published: (2023)

Multi-Sense Embeddings for Language Models and Knowledge Distillation
by: Wang, Qitong, et al.
Published: (2025)

Learning to Break: Knowledge-Enhanced Reasoning in Multi-Agent Debate System
by: Wang, Haotian, et al.
Published: (2023)

Piccolo2: General Text Embedding with Multi-task Hybrid Loss Training
by: Huang, Junqin, et al.
Published: (2024)

Enhancing Multilingual Embeddings via Multi-Way Parallel Text Alignment
by: Fazili, Barah, et al.
Published: (2026)

Llama2Vec: Unsupervised Adaptation of Large Language Models for Dense Retrieval
by: Liu, Zheng, et al.
Published: (2023)

Gecko: Versatile Text Embeddings Distilled from Large Language Models
by: Lee, Jinhyuk, et al.
Published: (2024)

Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddings
by: Mohr, Isabelle, et al.
Published: (2024)

Conan-Embedding-v2: Training an LLM from Scratch for Text Embeddings
by: Li, Shiyu, et al.
Published: (2025)

BeamAggR: Beam Aggregation Reasoning over Multi-source Knowledge for Multi-hop Question Answering
by: Chu, Zheng, et al.
Published: (2024)

Modelling Commonsense Commonalities with Multi-Facet Concept Embeddings
by: Kteich, Hanane, et al.
Published: (2024)

Discovering Multi-Scale Semantic Structure in Text Corpora Using Density-Based Trees and LLM Embeddings
by: Haschka, Thomas, et al.
Published: (2025)

Self-Distillation for Multi-Token Prediction
by: Zhao, Guoliang, et al.
Published: (2026)

Negative Matters: Multi-Granularity Hard-Negative Synthesis and Anchor-Token-Aware Pooling for Enhanced Text Embeddings
by: Pan, Tengyu, et al.
Published: (2025)

MoSE: Hierarchical Self-Distillation Enhances Early Layer Embeddings
by: Gurioli, Andrea, et al.
Published: (2025)

Understanding LLM Behavior in Multi-Target Cross-Lingual Summarization
by: Ryu, Sangwon, et al.
Published: (2026)

CAFES: A Collaborative Multi-Agent Framework for Multi-Granular Multimodal Essay Scoring
by: Su, Jiamin, et al.
Published: (2025)

AGRaME: Any-Granularity Ranking with Multi-Vector Embeddings
by: Reddy, Revanth Gangi, et al.
Published: (2024)

Adaptive Federated Distillation for Multi-Domain Non-IID Textual Data
by: Xiao, Jiahao, et al.
Published: (2025)

NormSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Fly
by: Fung, Yi R., et al.
Published: (2022)

Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation
by: Zhou, Yuhang, et al.
Published: (2024)

Efficient Multi-Hop Question Answering over Knowledge Graphs via LLM Planning and Embedding-Guided Search
by: Shrestha, Manil, et al.
Published: (2025)

Compressing Lengthy Context With UltraGist
by: Zhang, Peitian, et al.
Published: (2024)

LuxEmbedder: A Cross-Lingual Approach to Enhanced Luxembourgish Sentence Embeddings
by: Philippy, Fred, et al.
Published: (2024)

AsthmaBot: Multi-modal, Multi-Lingual Retrieval Augmented Generation For Asthma Patient Support
by: Bahaj, Adil, et al.
Published: (2024)

Extending Llama-3's Context Ten-Fold Overnight
by: Zhang, Peitian, et al.
Published: (2024)