Cover Image

Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ma, Guangyuan, Wu, Xing, Lin, Zijia, Hu, Songlin
Format:	Preprint
Published:	2024
Subjects:	Information Retrieval Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dense Passage Retrieval: Is it Retrieving?
by: Reichman, Benjamin, et al.
Published: (2024)

Cohort Retrieval using Dense Passage Retrieval
by: Jadhav, Pranav
Published: (2025)

Improve Dense Passage Retrieval with Entailment Tuning
by: Dai, Lu, et al.
Published: (2024)

LightRetriever: A LLM-based Text Retrieval Architecture with Extremely Faster Query Inference
by: Ma, Guangyuan, et al.
Published: (2025)

Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval
by: Ma, Guangyuan, et al.
Published: (2024)

TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questions
by: Abdallah, Abdelrahman, et al.
Published: (2025)

Spectral Tempering for Embedding Compression in Dense Passage Retrieval
by: Li, Yongkang, et al.
Published: (2026)

Pre-training vs. Fine-tuning: A Reproducibility Study on Dense Retrieval Knowledge Acquisition
by: Yao, Zheng, et al.
Published: (2025)

DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment
by: Li, Haitao, et al.
Published: (2024)

Silver Retriever: Advancing Neural Passage Retrieval for Polish Question Answering
by: Rybak, Piotr, et al.
Published: (2023)

DAPR: A Benchmark on Document-Aware Passage Retrieval
by: Wang, Kexin, et al.
Published: (2023)

DRAMA: Diverse Augmentation from Large Language Models to Smaller Dense Retrievers
by: Ma, Xueguang, et al.
Published: (2025)

QuCo-RAG: Quantifying Uncertainty from the Pre-training Corpus for Dynamic Retrieval-Augmented Generation
by: Min, Dehai, et al.
Published: (2025)

Deep Bag-of-Words Model: An Efficient and Interpretable Relevance Architecture for Chinese E-Commerce
by: Lin, Zhe, et al.
Published: (2024)

Study on LLMs for Promptagator-Style Dense Retriever Training
by: Gwon, Daniel, et al.
Published: (2025)

Passage-specific Prompt Tuning for Passage Reranking in Question Answering with Large Language Models
by: Wu, Xuyang, et al.
Published: (2024)

Scaling Laws For Dense Retrieval
by: Fang, Yan, et al.
Published: (2024)

Revela: Dense Retriever Learning via Language Modeling
by: Cai, Fengyu, et al.
Published: (2025)

Is It Novel and Why? Fine-Grained Patent Novelty Prediction Based on Passage Retrieval
by: Knappich, Valentin, et al.
Published: (2026)

History-Aware Conversational Dense Retrieval
by: Mo, Fengran, et al.
Published: (2024)

ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
by: Chaffin, Antoine, et al.
Published: (2026)

LACONIC: Dense-Level Effectiveness for Scalable Sparse Retrieval via a Two-Phase Training Curriculum
by: Xu, Zhichao, et al.
Published: (2026)

Semi-Parametric Retrieval via Binary Bag-of-Tokens Index
by: Zhou, Jiawei, et al.
Published: (2024)

Optimized Quran Passage Retrieval Using an Expanded QA Dataset and Fine-Tuned Language Models
by: Basem, Mohamed, et al.
Published: (2024)

Don't Retrieve, Generate: Prompting LLMs for Synthetic Training Data in Dense Retrieval
by: Sinha, Aarush
Published: (2025)

Improving Dense Passage Retrieval with Multiple Positive Passages
by: Chang, Shuai
Published: (2025)

PLAID SHIRTTT for Large-Scale Streaming Dense Retrieval
by: Lawrie, Dawn, et al.
Published: (2024)

Generative Dense Retrieval: Memory Can Be a Burden
by: Yuan, Peiwen, et al.
Published: (2024)

PairDistill: Pairwise Relevance Distillation for Dense Retrieval
by: Huang, Chao-Wei, et al.
Published: (2024)

Making Large Language Models Efficient Dense Retrievers
by: Lei, Yibin, et al.
Published: (2025)

GRITHopper: Decomposition-Free Multi-Hop Dense Retrieval
by: Erker, Justus-Jonas, et al.
Published: (2025)

ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval
by: Mao, Kelong, et al.
Published: (2024)

AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignment
by: Lai, Yilong, et al.
Published: (2024)

I^3 Retriever: Incorporating Implicit Interaction in Pre-trained Language Models for Passage Retrieval
by: Dong, Qian, et al.
Published: (2023)

Unsupervised Multilingual Dense Retrieval via Generative Pseudo Labeling
by: Huang, Chao-Wei, et al.
Published: (2024)

Unsupervised Corpus Poisoning Attacks in Continuous Space for Dense Retrieval
by: Li, Yongkang, et al.
Published: (2025)

Dense Retrieval for Low Resource Languages -- the Case of Amharic Language
by: Yeshambel, Tilahun, et al.
Published: (2025)

Reproducing HotFlip for Corpus Poisoning Attacks in Dense Retrieval
by: Li, Yongkang, et al.
Published: (2025)

RaDeR: Reasoning-aware Dense Retrieval Models
by: Das, Debrup, et al.
Published: (2025)

A Representation Sharpening Framework for Zero Shot Dense Retrieval
by: Ashok, Dhananjay, et al.
Published: (2025)