Cover Image

ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chaffin, Antoine, Arnaboldi, Luca, Chatelain, Amélie, Krzakala, Florent
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Simple Projection Variants Improve ColBERT Performance
by: Clavié, Benjamin, et al.
Published: (2025)

Extending Translate-Train for ColBERT-X to African Language CLIR
by: Yang, Eugene, et al.
Published: (2024)

ColBERT-XM: A Modular Multi-Vector Representation Model for Zero-Shot Multilingual Information Retrieval
by: Louis, Antoine, et al.
Published: (2024)

FGR-ColBERT: Identifying Fine-Grained Relevance Tokens During Retrieval
by: Jarolím, Antonín, et al.
Published: (2026)

ColBERT Retrieval and Ensemble Response Scoring for Language Model Question Answering
by: Gichamba, Alex, et al.
Published: (2024)

A model and package for German ColBERT
by: Dang, Thuong, et al.
Published: (2025)

Beyond Questions: Leveraging ColBERT for Keyphrase Search
by: Gabín, Jorge, et al.
Published: (2024)

Reproduction Beyond Benchmarks: ConstBERT and ColBERT-v2 Across Backends and Query Distributions
by: Ghosh, Utshab Kumar, et al.
Published: (2026)

Diagnosable ColBERT: Debugging Late-Interaction Retrieval Models Using a Learned Latent Space as Reference
by: Remy, François
Published: (2026)

Video-ColBERT: Contextualized Late Interaction for Text-to-Video Retrieval
by: Reddy, Arun, et al.
Published: (2025)

ColBERT-Att: Late-Interaction Meets Attention for Enhanced Retrieval
by: Patel, Raj Nath, et al.
Published: (2026)

ColBERT-serve: Efficient Multi-Stage Memory-Mapped Scoring
by: Huang, Kaili, et al.
Published: (2025)

HLTCOE at LiveRAG: GPT-Researcher using ColBERT retrieval
by: Duh, Kevin, et al.
Published: (2025)

Jina-ColBERT-v2: A General-Purpose Multilingual Late Interaction Retriever
by: Jha, Rohan, et al.
Published: (2024)

ColBERT's [MASK]-based Query Augmentation: Effects of Quadrupling the Query Input Length
by: Giacalone, Ben, et al.
Published: (2024)

Content-based 3D Image Retrieval and a ColBERT-inspired Re-ranking for Tumor Flagging and Staging
by: Jush, Farnaz Khun, et al.
Published: (2025)

ColBERT: Using BERT Sentence Embedding in Parallel Neural Networks for Computational Humor
by: Annamoradnejad, Issa, et al.
Published: (2020)

ModernBERT + ColBERT: Enhancing biomedical RAG through an advanced re-ranking retriever
by: Rivera, Eduardo Martínez, et al.
Published: (2025)

TurkColBERT: A Benchmark of Dense and Late-Interaction Models for Turkish Information Retrieval
by: Ezerceli, Özay, et al.
Published: (2025)

ClinicalEncoder26AM: A Multlilingual Diagnosable ColBERT Model; Evidences from the MultiClinNER Shared Task
by: Remy, François
Published: (2026)

PyLate: Flexible Training and Retrieval for Late Interaction Models
by: Chaffin, Antoine, et al.
Published: (2025)

Text Embeddings by Weakly-Supervised Contrastive Pre-training
by: Wang, Liang, et al.
Published: (2022)

NumColBERT: Non-Intrusive Numeracy Injection for Late-Interaction Retrieval Models
by: Fujimaki, Haruki, et al.
Published: (2026)

RecGPT: Generative Pre-training for Text-based Recommendation
by: Ngo, Hoang, et al.
Published: (2024)

Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval
by: Ma, Guangyuan, et al.
Published: (2024)

Pre-training Cross-lingual Open Domain Question Answering with Large-scale Synthetic Supervision
by: Jiang, Fan, et al.
Published: (2024)

Pre-training vs. Fine-tuning: A Reproducibility Study on Dense Retrieval Knowledge Acquisition
by: Yao, Zheng, et al.
Published: (2025)

FinBERT-QA: Financial Question Answering with pre-trained BERT Language Models
by: Yuan, Bithiah
Published: (2025)

Topic mining based on fine-tuning Sentence-BERT and LDA
by: Li, Jianheng, et al.
Published: (2025)

QuCo-RAG: Quantifying Uncertainty from the Pre-training Corpus for Dynamic Retrieval-Augmented Generation
by: Min, Dehai, et al.
Published: (2025)

DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment
by: Li, Haitao, et al.
Published: (2024)

Reducing the Footprint of Multi-Vector Retrieval with Minimal Performance Impact via Token Pooling
by: Clavié, Benjamin, et al.
Published: (2024)

Noise reduction in BERT NER models for clinical entity extraction
by: Jiwani, Kuldeep, et al.
Published: (2026)

FaBERT: Pre-training BERT on Persian Blogs
by: Masumi, Mostafa, et al.
Published: (2024)

ColPali: Efficient Document Retrieval with Vision Language Models
by: Faysse, Manuel, et al.
Published: (2024)

Best Practices for Distilling Large Language Models into BERT for Web Search Ranking
by: Ye, Dezhi, et al.
Published: (2024)

A BERT Based Hybrid Recommendation System For Academic Collaboration
by: N, Sangeetha, et al.
Published: (2025)

AdaptGOT: A Pre-trained Model for Adaptive Contextual POI Representation Learning
by: Ren, Xiaobin, et al.
Published: (2025)

Knowledge Graphs and Pre-trained Language Models enhanced Representation Learning for Conversational Recommender Systems
by: Qiu, Zhangchi, et al.
Published: (2023)

Within-Document Event Coreference with BERT-Based Contextualized Representations
by: Ahmed, Shafiuddin Rehan, et al.
Published: (2021)