Cover Image

TREC iKAT 2023: A Test Collection for Evaluating Conversational and Interactive Knowledge Assistants

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Aliannejadi, Mohammad, Abbasiantaeb, Zahra, Chatterjee, Shubham, Dalton, Jeffery, Azzopardi, Leif
Format:	Preprint
Published:	2024
Subjects:	Information Retrieval Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

TREC iKAT 2023: The Interactive Knowledge Assistance Track Overview
by: Aliannejadi, Mohammad, et al.
Published: (2024)

IRLab@iKAT24: Learned Sparse Retrieval with Multi-aspect LLM Query Generation for Conversational Search
by: Lupart, Simon, et al.
Published: (2024)

Conversational Gold: Evaluating Personalized Conversational Search System using Gold Nuggets
by: Abbasiantaeb, Zahra, et al.
Published: (2025)

Improving the Reusability of Conversational Search Test Collections
by: Abbasiantaeb, Zahra, et al.
Published: (2025)

Can We Use Large Language Models to Fill Relevance Judgment Holes?
by: Abbasiantaeb, Zahra, et al.
Published: (2024)

RALI@TREC iKAT 2024: Achieving Personalization via Retrieval Fusion in Conversational Search
by: Hui, Yuchen, et al.
Published: (2024)

Generating Multi-Aspect Queries for Conversational Search
by: Abbasiantaeb, Zahra, et al.
Published: (2024)

Towards Fair Rankings: Leveraging LLMs for Gender Bias Detection and Measurement
by: Mousavian, Maryam, et al.
Published: (2025)

A Conceptual Framework for Conversational Search and Recommendation: Conceptualizing Agent-Human Interactions During the Conversational Search Process
by: Azzopardi, Leif, et al.
Published: (2024)

CFDA & CLIP at TREC iKAT 2025: Enhancing Personalized Conversational Search via Query Reformulation and Rank Fusion
by: Chang, Yu-Cheng, et al.
Published: (2025)

Do Images Clarify? A Study on the Effect of Images on Clarifying Questions in Conversational Search
by: Siro, Clemencia, et al.
Published: (2026)

DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Search
by: Lupart, Simon, et al.
Published: (2024)

QDER: Query-Specific Document and Entity Representations for Multi-Vector Document Re-Ranking
by: Chatterjee, Shubham, et al.
Published: (2025)

Total Recall QA: A Verifiable Evaluation Suite for Deep Research Agents
by: Rafiee, Mahta, et al.
Published: (2026)

ChatR1: Reinforcement Learning for Conversational Reasoning and Retrieval Augmented Question Answering
by: Lupart, Simon, et al.
Published: (2025)

HLTCOE at TREC 2023 NeuCLIR Track
by: Yang, Eugene, et al.
Published: (2024)

TMU at TREC Clinical Trials Track 2023
by: Lahiri, Aritra Kumar, et al.
Published: (2024)

Conversational Search: From Fundamentals to Frontiers in the LLM Era
by: Mo, Fengran, et al.
Published: (2025)

AGENT-CQ: Automatic Generation and Evaluation of Clarifying Questions for Conversational Search with LLMs
by: Siro, Clemencia, et al.
Published: (2024)

Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs
by: Siro, Clemencia, et al.
Published: (2024)

Ranking Heterogeneous Search Result Pages using the Interactive Probability Ranking Principle
by: Pathak, Kanaad, et al.
Published: (2024)

Investigating LLM Variability in Personalized Conversational Information Retrieval
by: Lupart, Simon, et al.
Published: (2025)

REGENT: Relevance-Guided Attention for Entity-Aware Multi-Vector Neural Re-Ranking
by: Chatterjee, Shubham
Published: (2025)

Overview of the TREC 2023 deep learning track
by: Craswell, Nick, et al.
Published: (2025)

Overview of the TREC 2025 RAGTIME Track
by: Lawrie, Dawn, et al.
Published: (2026)

Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework
by: Pradeep, Ronak, et al.
Published: (2024)

Accessibility in Information Retrieval
by: Azzopardi, Leif, et al.
Published: (2024)

A Comparative Analysis of Faithfulness Metrics and Humans in Citation Evaluation
by: Zhang, Weijia, et al.
Published: (2024)

Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems
by: Siro, Clemencia, et al.
Published: (2024)

Towards Fine-Grained Citation Evaluation in Generated Text: A Comparative Analysis of Faithfulness Metrics
by: Zhang, Weijia, et al.
Published: (2024)

Information Farming: From Berry Picking to Berry Growing
by: Azzopardi, Leif, et al.
Published: (2026)

GenTREC: The First Test Collection Generated by Large Language Models for Evaluating Information Retrieval Systems
by: Türkmen, Mehmet Deniz, et al.
Published: (2025)

Interactions with Generative Information Retrieval Systems
by: Aliannejadi, Mohammad, et al.
Published: (2024)

Hypencoder Revisited: Reproducibility and Analysis of Non-Linear Scoring for First-Stage Retrieval
by: Eichholtz, Arne, et al.
Published: (2026)

PSCon: Product Search Through Conversations
by: Zou, Jie, et al.
Published: (2025)

Multi-Turn Multi-Modal Question Clarification for Enhanced Conversational Understanding
by: Ramezan, Kimia, et al.
Published: (2025)

Entities as Retrieval Signals: A Systematic Study of Coverage, Supervision, and Evaluation in Entity-Oriented Ranking
by: Chatterjee, Shubham
Published: (2026)

Overview of the TREC 2023 NeuCLIR Track
by: Lawrie, Dawn, et al.
Published: (2024)

Overview of the TREC 2022 deep learning track
by: Craswell, Nick, et al.
Published: (2025)

Overview of the TREC 2021 deep learning track
by: Craswell, Nick, et al.
Published: (2025)