RANKVIDEO: Reasoning Reranking for Text-to-Video Retrieval

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Skow, Tyler, Martin, Alexander, Van Durme, Benjamin, Chellappa, Rama, Kriz, Reno
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912873122365440
author Skow, Tyler
Martin, Alexander
Van Durme, Benjamin
Chellappa, Rama
Kriz, Reno
author_facet Skow, Tyler
Martin, Alexander
Van Durme, Benjamin
Chellappa, Rama
Kriz, Reno
contents Reranking is a critical component of modern retrieval systems, which typically pair an efficient first-stage retriever with a more expressive model to refine results. While large reasoning models have driven rapid progress in text-centric reranking, reasoning-based reranking for video retrieval remains underexplored. To address this gap, we introduce RANKVIDEO, a reasoning-based reranker for video retrieval that explicitly reasons over query-video pairs using video content to assess relevance. RANKVIDEO is trained using a two-stage curriculum consisting of perception-grounded supervised fine-tuning followed by reranking training that combines pointwise, pairwise, and teacher confidence distillation objectives, and is supported by a data synthesis pipeline for constructing reasoning-intensive query-video pairs. Experiments on the large-scale MultiVENT 2.0 benchmark demonstrate that RANKVIDEO consistently improves retrieval performance within a two-stage framework, yielding an average improvement of 31% on nDCG@10 and outperforming text-only and vision-language reranking alternatives, while more efficient.
format Preprint
id arxiv_https___arxiv_org_abs_2602_02444
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle RANKVIDEO: Reasoning Reranking for Text-to-Video Retrieval
Skow, Tyler
Martin, Alexander
Van Durme, Benjamin
Chellappa, Rama
Kriz, Reno
Information Retrieval
Computer Vision and Pattern Recognition
Reranking is a critical component of modern retrieval systems, which typically pair an efficient first-stage retriever with a more expressive model to refine results. While large reasoning models have driven rapid progress in text-centric reranking, reasoning-based reranking for video retrieval remains underexplored. To address this gap, we introduce RANKVIDEO, a reasoning-based reranker for video retrieval that explicitly reasons over query-video pairs using video content to assess relevance. RANKVIDEO is trained using a two-stage curriculum consisting of perception-grounded supervised fine-tuning followed by reranking training that combines pointwise, pairwise, and teacher confidence distillation objectives, and is supported by a data synthesis pipeline for constructing reasoning-intensive query-video pairs. Experiments on the large-scale MultiVENT 2.0 benchmark demonstrate that RANKVIDEO consistently improves retrieval performance within a two-stage framework, yielding an average improvement of 31% on nDCG@10 and outperforming text-only and vision-language reranking alternatives, while more efficient.
title RANKVIDEO: Reasoning Reranking for Text-to-Video Retrieval
topic Information Retrieval
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.02444