Imagen de Portada

SPECTRA: Synthetic IR Test Collections with Relevance Oracles and Controlled Distractor Diagnostics

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Liang, Eric
Formato:	Preprint
Publicado:	2026
Materias:	Information Retrieval Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Synthetic Test Collections for Retrieval Evaluation
por: Rahmani, Hossein A., et al.
Publicado: (2024)

ExaRanker-Open: Synthetic Explanation for IR using Open-Source LLMs
por: Ferraretto, Fernando, et al.
Publicado: (2024)

Bayesian Active Learning with Gaussian Processes Guided by LLM Relevance Scoring for Dense Passage Retrieval
por: Kim, Junyoung, et al.
Publicado: (2026)

Beyond Relevance: On the Relationship Between Retrieval and RAG Information Coverage
por: Samuel, Saron, et al.
Publicado: (2026)

Integrating Item Relevance in Training Loss for Sequential Recommender Systems
por: Bacciu, Andrea, et al.
Publicado: (2023)

Towards Competitive Search Relevance For Inference-Free Learned Sparse Retrievers
por: Geng, Zhichao, et al.
Publicado: (2024)

Optimizing Generative Ranking Relevance via Reinforcement Learning in Xiaohongshu Search
por: Zeng, Ziyang, et al.
Publicado: (2025)

Leveraging Large Language Models for Relevance Judgments in Legal Case Retrieval
por: Ma, Shengjie, et al.
Publicado: (2024)

LREF: A Novel LLM-based Relevance Framework for E-commerce
por: Tang, Tian, et al.
Publicado: (2025)

Calibration-Disentangled Learning and Relevance-Prioritized Reranking for Calibrated Sequential Recommendation
por: Jeon, Hyunsik, et al.
Publicado: (2024)

Tutorial on Reasoning for IR & IR for Reasoning
por: Hoveyda, Mohanna, et al.
Publicado: (2026)

AgriIR: A Scalable Framework for Domain-Specific Knowledge Retrieval
por: Seal, Shuvam Banerji, et al.
Publicado: (2026)

DisastIR: A Comprehensive Information Retrieval Benchmark for Disaster Management
por: Yin, Kai, et al.
Publicado: (2025)

When Relevance Meets Novelty: Dual-Stable Periodic Optimization for Serendipitous Recommendation
por: Lin, Hongxiang, et al.
Publicado: (2025)

Improving Ad matching via Cluster-Adaptive Keyword Expansion and Relevance tuning
por: Saha, Dipanwita, et al.
Publicado: (2025)

Xinyu AI Search: Enhanced Relevance and Comprehensive Results with Rich Answer Presentations
por: Tang, Bo, et al.
Publicado: (2025)

OrdRankBen: A Novel Ranking Benchmark for Ordinal Relevance in NLP
por: Wang, Yan, et al.
Publicado: (2025)

Optimizing Keyphrase Ranking for Relevance and Diversity Using Submodular Function Optimization (SFO)
por: Umair, Muhammad, et al.
Publicado: (2024)

CustomIR: Unsupervised Fine-Tuning of Dense Embeddings for Known Document Corpora
por: Paull, Nathan
Publicado: (2025)

Pathway to Relevance: How Cross-Encoders Implement a Semantic Variant of BM25
por: Lu, Meng, et al.
Publicado: (2025)

From Reasoning LLMs to BERT: A Two-Stage Distillation Framework for Search Relevance
por: Xia, Runze, et al.
Publicado: (2025)

AutoMIR: Effective Zero-Shot Medical Information Retrieval without Relevance Labels
por: Li, Lei, et al.
Publicado: (2024)

PRECTR: A Synergistic Framework for Integrating Personalized Search Relevance Matching and CTR Prediction
por: Chen, Rong, et al.
Publicado: (2025)

Towards Boosting LLMs-driven Relevance Modeling with Progressive Retrieved Behavior-augmented Prompting
por: Chen, Zeyuan, et al.
Publicado: (2024)

Relevance meets Diversity: A User-Centric Framework for Knowledge Exploration through Recommendations
por: Coppolillo, Erica, et al.
Publicado: (2024)

ReBOL: Retrieval via Bayesian Optimization with Batched LLM Relevance Observations and Query Reformulation
por: Korikov, Anton, et al.
Publicado: (2026)

R3A: Reinforced Reasoning for Relevance Assessment for RAG in User-Generated Content Platforms
por: Yuan, Xiaowei, et al.
Publicado: (2025)

Towards Understanding Bias in Synthetic Data for Evaluation
por: Rahmani, Hossein A., et al.
Publicado: (2025)

Fashion-AlterEval: A Dataset for Improved Evaluation of Conversational Recommendation Systems with Alternative Relevant Items
por: Vlachou, Maria
Publicado: (2025)

Interpreting Multilingual and Document-Length Sensitive Relevance Computations in Neural Retrieval Models through Axiomatic Causal Interventions
por: Savolainen, Oliver, et al.
Publicado: (2025)

Improving Vietnamese Legal Document Retrieval using Synthetic Data
por: Tien, Son Pham, et al.
Publicado: (2024)

Principled Synthetic Data Enables the First Scaling Laws for LLMs in Recommendation
por: Zhang, Benyu, et al.
Publicado: (2026)

InPars+: Supercharging Synthetic Data Generation for Information Retrieval Systems
por: Krastev, Matey, et al.
Publicado: (2025)

Generating Diverse Synthetic Datasets for Evaluation of Real-life Recommender Systems
por: Malenšek, Miha, et al.
Publicado: (2024)

A Recommender System for NFT Collectibles with Item Feature
por: Choi, Minjoo, et al.
Publicado: (2024)

PRECTR-V2:Unified Relevance-CTR Framework with Cross-User Preference Mining, Exposure Bias Correction, and LLM-Distilled Encoder Optimization
por: Cao, Shuzhi, et al.
Publicado: (2026)

COINBench: Moving Beyond Individual Perspectives to Collective Intent Understanding
por: Li, Xiaozhe, et al.
Publicado: (2026)

SemLink: A Semantic-Aware Automated Test Oracle for Hyperlink Verification using Siamese Sentence-BERT
por: Yang, Guan-Yan, et al.
Publicado: (2026)

Empowering Medical Equipment Sustainability in Low-Resource Settings: An AI-Powered Diagnostic and Support Platform for Biomedical Technicians
por: Atabonfack, Bernes Lorier, et al.
Publicado: (2026)

TREC iKAT 2023: A Test Collection for Evaluating Conversational and Interactive Knowledge Assistants
por: Aliannejadi, Mohammad, et al.
Publicado: (2024)