Text2Token: Unsupervised Text Representation Learning with Token Target Prediction
Fuente:
arXiv
Saved in:
| Main Authors: | An, Ruize, Zhang, Richong, Nie, Zhijie, Wu, Zhanyu, Zhang, Yanzhao, Long, Dingkun |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
A Text is Worth Several Tokens: Text Embedding from LLMs Secretly Aligns Well with The Key Tokens
by: Nie, Zhijie, et al.
Published: (2024)
by: Nie, Zhijie, et al.
Published: (2024)
When Text Embedding Meets Large Language Model: A Comprehensive Survey
by: Nie, Zhijie, et al.
Published: (2024)
by: Nie, Zhijie, et al.
Published: (2024)
ERank: Fusing Supervised Fine-Tuning and Reinforcement Learning for Effective and Efficient Text Reranking
by: Cai, Yuzheng, et al.
Published: (2025)
by: Cai, Yuzheng, et al.
Published: (2025)
Learning to Select: Query-Aware Adaptive Dimension Selection for Dense Retrieval
by: Wu, Zhanyu, et al.
Published: (2026)
by: Wu, Zhanyu, et al.
Published: (2026)
mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval
by: Zhang, Xin, et al.
Published: (2024)
by: Zhang, Xin, et al.
Published: (2024)
E2Rank: Your Text Embedding can Also be an Effective and Efficient Listwise Reranker
by: Liu, Qi, et al.
Published: (2025)
by: Liu, Qi, et al.
Published: (2025)
Towards Text-Image Interleaved Retrieval
by: Zhang, Xin, et al.
Published: (2025)
by: Zhang, Xin, et al.
Published: (2025)
Improving General Text Embedding Model: Tackling Task Conflict and Data Imbalance through Model Merging
by: Li, Mingxin, et al.
Published: (2024)
by: Li, Mingxin, et al.
Published: (2024)
LaSER: Internalizing Explicit Reasoning into Latent Space for Dense Retrieval
by: Jin, Jiajie, et al.
Published: (2026)
by: Jin, Jiajie, et al.
Published: (2026)
A Two-Stage Adaptation of Large Language Models for Text Ranking
by: Zhang, Longhui, et al.
Published: (2023)
by: Zhang, Longhui, et al.
Published: (2023)
GME: Improving Universal Multimodal Retrieval by Multimodal LLMs
by: Zhang, Xin, et al.
Published: (2024)
by: Zhang, Xin, et al.
Published: (2024)
DiffuRank: Effective Document Reranking with Diffusion Language Models
by: Liu, Qi, et al.
Published: (2026)
by: Liu, Qi, et al.
Published: (2026)
Supervised Fine-Tuning or Contrastive Learning? Towards Better Multimodal LLM Reranking
by: Dai, Ziqi, et al.
Published: (2025)
by: Dai, Ziqi, et al.
Published: (2025)
HeceTokenizer: A Syllable-Based Tokenization Approach for Turkish Retrieval
by: Gulgonul, Senol
Published: (2026)
by: Gulgonul, Senol
Published: (2026)
Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing
by: Song, Tingyu, et al.
Published: (2026)
by: Song, Tingyu, et al.
Published: (2026)
TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendation
by: Qu, Haohao, et al.
Published: (2024)
by: Qu, Haohao, et al.
Published: (2024)
FIT-RAG: Black-Box RAG with Factual Information and Token Reduction
by: Mao, Yuren, et al.
Published: (2024)
by: Mao, Yuren, et al.
Published: (2024)
From Tokens to Concepts: Leveraging SAE for SPLADE
by: Zong, Yuxuan, et al.
Published: (2026)
by: Zong, Yuxuan, et al.
Published: (2026)
ITEm: Unsupervised Image-Text Embedding Learning for eCommerce
by: Liao, Baohao, et al.
Published: (2023)
by: Liao, Baohao, et al.
Published: (2023)
Towards Universal Video Retrieval: Generalizing Video Embedding via Synthesized Multimodal Pyramid Curriculum
by: Guo, Zhuoning, et al.
Published: (2025)
by: Guo, Zhuoning, et al.
Published: (2025)
Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddings
by: Mohr, Isabelle, et al.
Published: (2024)
by: Mohr, Isabelle, et al.
Published: (2024)
Rethinking the Role of Token Retrieval in Multi-Vector Retrieval
by: Lee, Jinhyuk, et al.
Published: (2023)
by: Lee, Jinhyuk, et al.
Published: (2023)
Learning Decomposed Contextual Token Representations from Pretrained and Collaborative Signals for Generative Recommendation
by: Liu, Yifan, et al.
Published: (2025)
by: Liu, Yifan, et al.
Published: (2025)
Token and Span Classification for Entity Recognition in French Historical Encyclopedias
by: Moncla, Ludovic, et al.
Published: (2025)
by: Moncla, Ludovic, et al.
Published: (2025)
Rethinking the Privacy of Text Embeddings: A Reproducibility Study of "Text Embeddings Reveal (Almost) As Much As Text"
by: Seputis, Dominykas, et al.
Published: (2025)
by: Seputis, Dominykas, et al.
Published: (2025)
Jointly Generating and Attributing Answers using Logits of Document-Identifier Tokens
by: Albarede, Lucas, et al.
Published: (2025)
by: Albarede, Lucas, et al.
Published: (2025)
Rethinking Schema Linking: A Context-Aware Bidirectional Retrieval Approach for Text-to-SQL
by: Nahid, Md Mahadi Hasan, et al.
Published: (2025)
by: Nahid, Md Mahadi Hasan, et al.
Published: (2025)
MCiteBench: A Multimodal Benchmark for Generating Text with Citations
by: Hu, Caiyu, et al.
Published: (2025)
by: Hu, Caiyu, et al.
Published: (2025)
Text Data Integration
by: Rahman, Md Ataur, et al.
Published: (2026)
by: Rahman, Md Ataur, et al.
Published: (2026)
An Early FIRST Reproduction and Improvements to Single-Token Decoding for Fast Listwise Reranking
by: Chen, Zijian, et al.
Published: (2024)
by: Chen, Zijian, et al.
Published: (2024)
FGR-ColBERT: Identifying Fine-Grained Relevance Tokens During Retrieval
by: Jarolím, Antonín, et al.
Published: (2026)
by: Jarolím, Antonín, et al.
Published: (2026)
Retrieval Augmented Generation with Collaborative Filtering for Personalized Text Generation
by: Shi, Teng, et al.
Published: (2025)
by: Shi, Teng, et al.
Published: (2025)
Text Clustering as Classification with LLMs
by: Huang, Chen, et al.
Published: (2024)
by: Huang, Chen, et al.
Published: (2024)
xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token
by: Cheng, Xin, et al.
Published: (2024)
by: Cheng, Xin, et al.
Published: (2024)
Text2Cypher Across Languages: Evaluating and Finetuning LLMs
by: Ozsoy, Makbule Gulcin, et al.
Published: (2025)
by: Ozsoy, Makbule Gulcin, et al.
Published: (2025)
OkraLong: A Flexible Retrieval-Augmented Framework for Long-Text Query Processing
by: Hui, Yulong, et al.
Published: (2025)
by: Hui, Yulong, et al.
Published: (2025)
RAPID: Retrieval-Augmented Parallel Inference Drafting for Text-Based Video Event Retrieval
by: Nguyen, Long, et al.
Published: (2025)
by: Nguyen, Long, et al.
Published: (2025)
Semantic Convergence: Harmonizing Recommender Systems via Two-Stage Alignment and Behavioral Semantic Tokenization
by: Li, Guanghan, et al.
Published: (2024)
by: Li, Guanghan, et al.
Published: (2024)
Evolving Text Data Stream Mining
by: Kumar, Jay
Published: (2024)
by: Kumar, Jay
Published: (2024)
Survey of Query-based Text Summarization
by: Yu, Hang, et al.
Published: (2022)
by: Yu, Hang, et al.
Published: (2022)
Similar Items
-
A Text is Worth Several Tokens: Text Embedding from LLMs Secretly Aligns Well with The Key Tokens
by: Nie, Zhijie, et al.
Published: (2024) -
When Text Embedding Meets Large Language Model: A Comprehensive Survey
by: Nie, Zhijie, et al.
Published: (2024) -
ERank: Fusing Supervised Fine-Tuning and Reinforcement Learning for Effective and Efficient Text Reranking
by: Cai, Yuzheng, et al.
Published: (2025) -
Learning to Select: Query-Aware Adaptive Dimension Selection for Dense Retrieval
by: Wu, Zhanyu, et al.
Published: (2026) -
mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval
by: Zhang, Xin, et al.
Published: (2024)