Imagen de Portada

Causal2Vec: Improving Decoder-only LLMs as Embedding Models through a Contextual Token

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lin, Ailiang, Li, Zhuoyun, Wang, Yusong, Funakoshi, Kotaro, Okumura, Manabu
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Embedding-based In-Context Prompt Training for Enhancing LLMs as Text Encoders
por: Lin, Ailiang, et al.
Publicado: (2026)

Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation
por: Lyu, Boxuan, et al.
Publicado: (2024)

Minimum Bayes Risk Decoding for Error Span Detection in Reference-Free Automatic Machine Translation Evaluation
por: Lyu, Boxuan, et al.
Publicado: (2025)

Automatic Answerability Evaluation for Question Generation
por: Wang, Zifan, et al.
Publicado: (2023)

Active Learning with Task Adaptation Pre-training for Speech Emotion Recognition
por: Li, Dongyuan, et al.
Publicado: (2024)

Emotion Recognition in Signers
por: Funakoshi, Kotaro, et al.
Publicado: (2025)

DiLM: Distilling Dataset into Language Model for Text-level Dataset Distillation
por: Maekawa, Aru, et al.
Publicado: (2024)

StableMask: Refining Causal Masking in Decoder-only Transformer
por: Yin, Qingyu, et al.
Publicado: (2024)

Who Laughs with Whom? Disentangling Influential Factors in Humor Preferences across User Clusters and LLMs
por: Murakami, Soichiro, et al.
Publicado: (2026)

Spoken Word2Vec: Learning Skipgram Embeddings from Speech
por: Sayeed, Mohammad Amaan, et al.
Publicado: (2023)

InstructCMP: Length Control in Sentence Compression through Instruction-based Large Language Models
por: Juseon-Do, et al.
Publicado: (2024)

Emotion Recognition in Multi-Speaker Conversations through Speaker Identification, Knowledge Distillation, and Hierarchical Fusion
por: Li, Xiao, et al.
Publicado: (2025)

Enhancing Contextual Understanding in Large Language Models through Contrastive Decoding
por: Zhao, Zheng, et al.
Publicado: (2024)

Improve Decoding Factuality by Token-wise Cross Layer Entropy of Large Language Models
por: Wu, Jialiang, et al.
Publicado: (2025)

Dodo: Dynamic Contextual Compression for Decoder-only LMs
por: Qin, Guanghui, et al.
Publicado: (2023)

Token Constraint Decoding Improves Robustness on Question Answering for Large Language Models
por: Yao, Jui-Ming, et al.
Publicado: (2025)

Oogiri-Master: Benchmarking Humor Understanding via Oogiri
por: Murakami, Soichiro, et al.
Publicado: (2025)

SEED: A Structural Encoder for Embedding-Driven Decoding in Time Series Prediction with LLMs
por: Li, Fengze, et al.
Publicado: (2025)

Direct Multi-Token Decoding
por: Luo, Xuan, et al.
Publicado: (2025)

RACER: Retrieval-Augmented Contextual Rapid Speculative Decoding
por: Zhang, Zihong, et al.
Publicado: (2026)

Contextual Categorization Enhancement through LLMs Latent-Space
por: Bettouche, Zineddine, et al.
Publicado: (2024)

Token Prepending: A Training-Free Approach for Eliciting Better Sentence Embeddings from LLMs
por: Fu, Yuchen, et al.
Publicado: (2024)

Reconsidering Degeneration of Token Embeddings with Definitions for Encoder-based Pre-trained Language Models
por: Zhang, Ying, et al.
Publicado: (2024)

Contextual Document Embeddings
por: Morris, John X., et al.
Publicado: (2024)

VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks
por: Jiang, Ziyan, et al.
Publicado: (2024)

Mitigating Context-Memory Conflicts in LLMs through Dynamic Cognitive Reconciliation Decoding
por: Zhou, Yigeng, et al.
Publicado: (2026)

Token Signature: Predicting Chain-of-Thought Gains with Token Decoding Feature in Large Language Models
por: Liu, Peijie, et al.
Publicado: (2025)

Memory Retrieval and Consolidation in Large Language Models through Function Tokens
por: Zhang, Shaohua, et al.
Publicado: (2025)

Contextual Reinforcement in Multimodal Token Compression for Large Language Models
por: Piero, Naderdel, et al.
Publicado: (2025)

Sticking to the Mean: Detecting Sticky Tokens in Text Embedding Models
por: Chen, Kexin, et al.
Publicado: (2025)

LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders
por: BehnamGhader, Parishad, et al.
Publicado: (2024)

Tokenization Matters! Degrading Large Language Models through Challenging Their Tokenization
por: Wang, Dixuan, et al.
Publicado: (2024)

LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token Embeddings
por: Wang, Duo, et al.
Publicado: (2024)

AdParaphrase: Paraphrase Dataset for Analyzing Linguistic Features toward Generating Attractive Ad Texts
por: Murakami, Soichiro, et al.
Publicado: (2025)

Scientific Knowledge-driven Decoding Constraints Improving the Reliability of LLMs
por: Ma, Maotian, et al.
Publicado: (2026)

METER: Evaluating Multi-Level Contextual Causal Reasoning in Large Language Models
por: Li, Pengfeng, et al.
Publicado: (2026)

One Token Is Enough: Improving Diffusion Language Models with a Sink Token
por: Zhang, Zihou, et al.
Publicado: (2026)

Decoding at the Speed of Thought: Harnessing Parallel Decoding of Lexical Units for LLMs
por: Sun, Chenxi, et al.
Publicado: (2024)

Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
por: Phan, Phuc, et al.
Publicado: (2024)

Dynamic Depth Decoding: Faster Speculative Decoding for LLMs
por: Brown, Oscar, et al.
Publicado: (2024)