Cover Image

Can We Hide Machines in the Crowd? Quantifying Equivalence in LLM-in-the-loop Annotation Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	He, Jiaman, Leng, Zikang, McKay, Dana, Spina, Damiano, Trippas, Johanne R.
Format:	Preprint
Published:	2025
Subjects:	Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Characterising Topic Familiarity and Query Specificity Using Eye-Tracking Data
by: He, Jiaman, et al.
Published: (2025)

Characterizing Personality from Eye-Tracking: The Role of Gaze and Its Absence in Interactive Search Environments
by: He, Jiaman, et al.
Published: (2026)

Can Users Detect Biases or Factual Errors in Generated Responses in Conversational Information-Seeking?
by: Łajewska, Weronika, et al.
Published: (2024)

Explainability for Transparent Conversational Information-Seeking
by: Łajewska, Weronika, et al.
Published: (2024)

Towards Investigating Biases in Spoken Conversational Search
by: Cherumanal, Sachin Pathiyan, et al.
Published: (2024)

Towards Detecting and Mitigating Cognitive Bias in Spoken Conversational Search
by: Ji, Kaixin, et al.
Published: (2024)

Multi-stage Large Language Model Pipelines Can Outperform GPT-4o in Relevance Assessment
by: Schnabel, Julian A., et al.
Published: (2025)

Walert: Putting Conversational Search Knowledge into Action by Building and Evaluating a Large Language Model-Powered Chatbot
by: Cherumanal, Sachin Pathiyan, et al.
Published: (2024)

Online and Offline Evaluation in Search Clarification
by: Tavakoli, Leila, et al.
Published: (2024)

The Effects of Demographic Instructions on LLM Personas
by: de Paula, Angel Felipe Magnossão, et al.
Published: (2025)

ISMIE: A Framework to Characterize Information Seeking in Modern Information Environments
by: Sun, Shuoqi, et al.
Published: (2025)

Can LLM Annotations Replace User Clicks for Learning to Rank?
by: Yu, Lulu, et al.
Published: (2025)

Can't Hide Behind the API: Stealing Black-Box Commercial Embedding Models
by: Tamber, Manveer Singh, et al.
Published: (2024)

Enhanced Bloom's Educational Taxonomy for Fostering Information Literacy in the Era of Large Language Models
by: Luo, Yiming, et al.
Published: (2025)

RMIT-ADM+S at the SIGIR 2025 LiveRAG Challenge
by: Ran, Kun, et al.
Published: (2025)

Control Search Rankings, Control the World: What is a Good Search Engine?
by: Coghlan, Simon, et al.
Published: (2025)

Can We Trust Recommender System Fairness Evaluation? The Role of Fairness and Relevance
by: Rampisela, Theresia Veronika, et al.
Published: (2024)

LLM-Powered Nuanced Video Attribute Annotation for Enhanced Recommendations
by: Long, Boyuan, et al.
Published: (2025)

Hide Your Model: A Parameter Transmission-free Federated Recommender System
by: Yuan, Wei, et al.
Published: (2023)

Can We Predict the Next Question? A Collaborative Filtering Approach to Modeling User Behavior
by: Fu, Bokang, et al.
Published: (2025)

The Crowd in MOOCs: A Study of Learning Patterns at Scale
by: Zhou, Xin, et al.
Published: (2024)

Function-based Labels for Complementary Recommendation: Definition, Annotation, and LLM-as-a-Judge
by: Yamasaki, Chihiro, et al.
Published: (2025)

Quantifying Query Fairness Under Unawareness
by: Jaenich, Thomas, et al.
Published: (2025)

Think Before Writing: Feature-Level Multi-Objective Optimization for Generative Citation Visibility
by: Liu, Zikang, et al.
Published: (2026)

Preserving Individuality while Following the Crowd: Understanding the Role of User Taste and Crowd Wisdom in Online Product Rating Prediction
by: Wang, Liang, et al.
Published: (2024)

Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024
by: Breuer, Timo, et al.
Published: (2024)

Have We Really Understood Collaborative Information? An Empirical Investigation
by: Zhang, Xiaokun, et al.
Published: (2025)

Annotative Indexing
by: Clarke, Charles L. A.
Published: (2024)

Can We Use Large Language Models to Fill Relevance Judgment Holes?
by: Abbasiantaeb, Zahra, et al.
Published: (2024)

Can We Find the Code? An Empirical Study of Google Scholar's Code Retrieval
by: Chen, Shi-Shun
Published: (2025)

Guidelines for the Creation of an Annotated Corpus
by: Boudoua, Bahdja, et al.
Published: (2026)

Can We Mathematically Spot Possible Manipulation of Results in Research Manuscripts Using Benford's Law?
by: Lazebnik, Teddy, et al.
Published: (2023)

Joint Optimization of Relevance and Engagement in Multi-Task Ranking for E-Commerce with Efficient LLM Supervision
by: Chen, Luming, et al.
Published: (2026)

Brain-Machine Interfaces & Information Retrieval Challenges and Opportunities
by: Moshfeghi, Yashar, et al.
Published: (2025)

Now That We've Found the "Hidden Web," What Can We Do with It?
by: Cole, Timothy W., et al.
Published: (2002)

Paragon: Parameter Generation for Controllable Multi-Task Recommendation
by: Shen, Chenglei, et al.
Published: (2024)

FeDecider: An LLM-Based Framework for Federated Cross-Domain Recommendation
by: He, Xinrui, et al.
Published: (2026)

Exploiting the Randomness of Large Language Models (LLM) in Text Classification Tasks: Locating Privileged Documents in Legal Matters
by: Huffman, Keith, et al.
Published: (2025)

Touch the Core: Exploring Task Dependence Among Hybrid Targets for Recommendation
by: Tang, Xing, et al.
Published: (2024)

In Crowd Veritas: Leveraging Human Intelligence To Fight Misinformation
by: Soprano, Michael
Published: (2025)