Pooling and Semantic Shift: The Fundamental Challenges in Long Text Embedding and Retrieval
Fuente:
arXiv
Saved in:
| Main Authors: | Gao, Hang, Xu, Wujiang, Mei, Kai, Metaxas, Dimitris N. |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Trust or Abstain? A Self-Aware RAG Approach
by: Zhu, Xi, et al.
Published: (2026)
by: Zhu, Xi, et al.
Published: (2026)
Lessons Learned on Information Retrieval in Electronic Health Records: A Comparison of Embedding Models and Pooling Strategies
by: Myers, Skatje, et al.
Published: (2024)
by: Myers, Skatje, et al.
Published: (2024)
Token-Controlled Re-ranking for Sequential Recommendation via LLMs
by: Dai, Wenxi, et al.
Published: (2025)
by: Dai, Wenxi, et al.
Published: (2025)
ReinPool: Reinforcement Learning Pooling Multi-Vector Embeddings for Retrieval System
by: Cha, Sungguk, et al.
Published: (2026)
by: Cha, Sungguk, et al.
Published: (2026)
ReasonEmbed: Enhanced Text Embeddings for Reasoning-Intensive Document Retrieval
by: Chen, Jianlyu, et al.
Published: (2025)
by: Chen, Jianlyu, et al.
Published: (2025)
iAgent: LLM Agent as a Shield between User and Recommender Systems
by: Xu, Wujiang, et al.
Published: (2025)
by: Xu, Wujiang, et al.
Published: (2025)
LMK > CLS: Landmark Pooling for Dense Embeddings
by: Doshi, Meet, et al.
Published: (2026)
by: Doshi, Meet, et al.
Published: (2026)
Pooling And Attention: What Are Effective Designs For LLM-Based Embedding Models?
by: Tang, Yixuan, et al.
Published: (2024)
by: Tang, Yixuan, et al.
Published: (2024)
Vector Retrieval with Similarity and Diversity: How Hard Is It?
by: Gao, Hang, et al.
Published: (2024)
by: Gao, Hang, et al.
Published: (2024)
OkraLong: A Flexible Retrieval-Augmented Framework for Long-Text Query Processing
by: Hui, Yulong, et al.
Published: (2025)
by: Hui, Yulong, et al.
Published: (2025)
Retrieval Augmented Generation with Collaborative Filtering for Personalized Text Generation
by: Shi, Teng, et al.
Published: (2025)
by: Shi, Teng, et al.
Published: (2025)
Dwell in the Beginning: How Language Models Embed Long Documents for Dense Retrieval
by: Coelho, João, et al.
Published: (2024)
by: Coelho, João, et al.
Published: (2024)
mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval
by: Zhang, Xin, et al.
Published: (2024)
by: Zhang, Xin, et al.
Published: (2024)
Exploring Selective Retrieval-Augmentation for Long-Tail Legal Text Classification
by: Mao, Boheng
Published: (2025)
by: Mao, Boheng
Published: (2025)
Semantic Certainty Assessment in Vector Retrieval Systems: A Novel Framework for Embedding Quality Evaluation
by: Du, Y.
Published: (2025)
by: Du, Y.
Published: (2025)
Text Data Integration
by: Rahman, Md Ataur, et al.
Published: (2026)
by: Rahman, Md Ataur, et al.
Published: (2026)
Rethinking the Privacy of Text Embeddings: A Reproducibility Study of "Text Embeddings Reveal (Almost) As Much As Text"
by: Seputis, Dominykas, et al.
Published: (2025)
by: Seputis, Dominykas, et al.
Published: (2025)
Hierarchical Semantic Retrieval with Cobweb
by: Gupta, Anant, et al.
Published: (2025)
by: Gupta, Anant, et al.
Published: (2025)
Survey of Query-based Text Summarization
by: Yu, Hang, et al.
Published: (2022)
by: Yu, Hang, et al.
Published: (2022)
Shifting from Ranking to Set Selection for Retrieval Augmented Generation
by: Lee, Dahyun, et al.
Published: (2025)
by: Lee, Dahyun, et al.
Published: (2025)
Llama-Embed-Nemotron-8B: A Universal Text Embedding Model for Multilingual and Cross-Lingual Tasks
by: Babakhin, Yauhen, et al.
Published: (2025)
by: Babakhin, Yauhen, et al.
Published: (2025)
Improving Text Embeddings with Large Language Models
by: Wang, Liang, et al.
Published: (2023)
by: Wang, Liang, et al.
Published: (2023)
EmbeddingRWKV: State-Centric Retrieval with Reusable States
by: Hou, Haowen, et al.
Published: (2026)
by: Hou, Haowen, et al.
Published: (2026)
An Open-Source Dual-Loss Embedding Model for Semantic Retrieval in Higher Education
by: Sajja, Ramteja, et al.
Published: (2025)
by: Sajja, Ramteja, et al.
Published: (2025)
Multi-Step Semantic Reasoning in Generative Retrieval
by: Dong, Steven, et al.
Published: (2026)
by: Dong, Steven, et al.
Published: (2026)
ChEmbed: Enhancing Chemical Literature Search Through Domain-Specific Text Embeddings
by: Kasmaee, Ali Shiraee, et al.
Published: (2025)
by: Kasmaee, Ali Shiraee, et al.
Published: (2025)
Exploring the Landscape of Text-to-SQL with Large Language Models: Progresses, Challenges and Opportunities
by: Huang, Yiming, et al.
Published: (2025)
by: Huang, Yiming, et al.
Published: (2025)
On the Challenges and Opportunities of Learned Sparse Retrieval for Code
by: Lupart, Simon, et al.
Published: (2026)
by: Lupart, Simon, et al.
Published: (2026)
JFinTEB: Japanese Financial Text Embedding Benchmark
by: Suzuki, Masahiro, et al.
Published: (2026)
by: Suzuki, Masahiro, et al.
Published: (2026)
Multi-word Term Embeddings Improve Lexical Product Retrieval
by: Shcherbakov, Viktor, et al.
Published: (2024)
by: Shcherbakov, Viktor, et al.
Published: (2024)
Text Embeddings by Weakly-Supervised Contrastive Pre-training
by: Wang, Liang, et al.
Published: (2022)
by: Wang, Liang, et al.
Published: (2022)
FinMTEB: Finance Massive Text Embedding Benchmark
by: Tang, Yixuan, et al.
Published: (2025)
by: Tang, Yixuan, et al.
Published: (2025)
Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaning
by: Sun, Yiqun, et al.
Published: (2025)
by: Sun, Yiqun, et al.
Published: (2025)
Arctic-Embed: Scalable, Efficient, and Accurate Text Embedding Models
by: Merrick, Luke, et al.
Published: (2024)
by: Merrick, Luke, et al.
Published: (2024)
Improving Document Retrieval Coherence for Semantically Equivalent Queries
by: Campese, Stefano, et al.
Published: (2025)
by: Campese, Stefano, et al.
Published: (2025)
RAPID: Retrieval-Augmented Parallel Inference Drafting for Text-Based Video Event Retrieval
by: Nguyen, Long, et al.
Published: (2025)
by: Nguyen, Long, et al.
Published: (2025)
VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval
by: Zhou, Junjie, et al.
Published: (2024)
by: Zhou, Junjie, et al.
Published: (2024)
Influence Guided Sampling for Domain Adaptation of Text Retrievers
by: Doshi, Meet, et al.
Published: (2026)
by: Doshi, Meet, et al.
Published: (2026)
Analysis of Plan-based Retrieval for Grounded Text Generation
by: Godbole, Ameya, et al.
Published: (2024)
by: Godbole, Ameya, et al.
Published: (2024)
Beyond Single Embeddings: Capturing Diverse Targets with Multi-Query Retrieval
by: Chen, Hung-Ting, et al.
Published: (2025)
by: Chen, Hung-Ting, et al.
Published: (2025)
Similar Items
-
Trust or Abstain? A Self-Aware RAG Approach
by: Zhu, Xi, et al.
Published: (2026) -
Lessons Learned on Information Retrieval in Electronic Health Records: A Comparison of Embedding Models and Pooling Strategies
by: Myers, Skatje, et al.
Published: (2024) -
Token-Controlled Re-ranking for Sequential Recommendation via LLMs
by: Dai, Wenxi, et al.
Published: (2025) -
ReinPool: Reinforcement Learning Pooling Multi-Vector Embeddings for Retrieval System
by: Cha, Sungguk, et al.
Published: (2026) -
ReasonEmbed: Enhanced Text Embeddings for Reasoning-Intensive Document Retrieval
by: Chen, Jianlyu, et al.
Published: (2025)