Cover Image

A Longitudinal Study on Different Annotator Feedback Loops in Complex RAG Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Rosenthal, Sara, Hanafi, Maeda, Katsis, Yannis, Popa, Lucian, Danilevsky, Marina
Format:	Preprint
Published:	2025
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RAGAPHENE: A RAG Annotation Platform with Human Enhancements and Edits
by: Fadnis, Kshitij, et al.
Published: (2025)

InspectorRAGet: An Introspection Platform for RAG Evaluation
by: Fadnis, Kshitij, et al.
Published: (2024)

MTRAG-UN: A Benchmark for Open Challenges in Multi-Turn RAG Conversations
by: Rosenthal, Sara, et al.
Published: (2026)

Leveraging Large Language Models to Enhance Domain Expert Inclusion in Data Science Workflows
by: Shih, Jasmine Y., et al.
Published: (2024)

Emerging Reliance Behaviors in Human-AI Content Grounded Data Generation: The Role of Cognitive Forcing Functions and Hallucinations
by: Ashktorab, Zahra, et al.
Published: (2024)

Investigating the Task Load of Investigating the Task Load in Visualization Studies
by: Pahr, Daniel, et al.
Published: (2025)

Efficacy of AI RAG Tools for Complex Information Extraction and Data Annotation Tasks: A Case Study Using Banks Public Disclosures
by: Botti, Nicholas, et al.
Published: (2025)

Dynamic Personalization Through Continuous Feedback Loops in Interactive AI Systems
by: He, Liu
Published: (2026)

A Closed-Loop CPR Training Glove with Integrated Tactile Sensing and Haptic Feedback
by: Moon, Jaeyoung, et al.
Published: (2026)

Civil Society in the Loop: Feedback-Driven Adaptation of (L)LM-Assisted Classification in an Open-Source Telegram Monitoring Tool
by: Pustet, Milena, et al.
Published: (2025)

Same Feedback, Different Source: How AI vs. Human Feedback Shapes Learner Engagement
by: Morris, Caitlin, et al.
Published: (2026)

The Role of Task Complexity in Reducing AI Plagiarism: A Study of Generative AI Tools
by: Toker, Sacip, et al.
Published: (2024)

Audience in the Loop: Viewer Feedback-Driven Content Creation in Micro-drama Production on Social Media
by: Cao, Gengchen, et al.
Published: (2026)

Small Cues, Big Differences: Evaluating Interaction and Presentation for Annotation Retrieval in AR
by: Borhani, Zahra, et al.
Published: (2025)

Echoes in the Loop: Diagnosing Risks in LLM-Powered Recommender Systems under Feedback Loops
by: Park, Donguk, et al.
Published: (2026)

Same Feedback, Different Source: How AI vs. Human Feedback Attribution and Credibility Shape Learner Behavior in Computing Education
by: Morris, Caitlin, et al.
Published: (2026)

Multimodal Feedback for Task Guidance in Augmented Reality
by: Guo, Hu, et al.
Published: (2025)

From Checking to Sensemaking: A Caregiver-in-the-Loop Framework for AI-Assisted Task Verification in Dementia Care
by: Lai, Joy, et al.
Published: (2025)

DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented Interfaces
by: Xu, Yuan, et al.
Published: (2025)

Intuitive interaction flow: A Dual-Loop Human-Machine Collaboration Task Allocation Model and an experimental study
by: Xu, Jiang, et al.
Published: (2024)

Efficient Online Crowdsourcing with Complex Annotations
by: Meir, Reshef, et al.
Published: (2024)

Gender and Careers in Platform-Mediated Work: A Longitudinal Study of Online Freelancers
by: Kim, Pyeonghwa, et al.
Published: (2025)

A Two-Stage Learning-to-Defer Approach for Multi-Task Learning
by: Montreuil, Yannis, et al.
Published: (2024)

MarkupLens: Balancing Computer Vision Assistance and Control in Professional Video Annotation for Video-Based Design Tasks
by: He, Tianhao, et al.
Published: (2024)

Eliciting New Perspectives in RtD Studies through Annotated Portfolios: A Case Study of Robotic Artefacts
by: Hoggenmuller, Marius, et al.
Published: (2024)

A Study on Interaction Complexity and Time
by: Bonora, Leonardo Germán Loza, et al.
Published: (2025)

MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systems
by: Katsis, Yannis, et al.
Published: (2025)

Mastery Learning Improves Performance on Complex Tasks on PCP Literacy Test
by: Srinivas, Chandana, et al.
Published: (2025)

A Case Study of Scalable Content Annotation Using Multi-LLM Consensus and Human Review
by: Yuan, Mingyue, et al.
Published: (2025)

Enhancing Generative AI Image Refinement with Scribbles and Annotations: A Comparative Study of Multimodal Prompts
by: Park, Hyerim, et al.
Published: (2026)

Human Response to Decision Support in Face Matching: The Influence of Task Difficulty and Machine Accuracy
by: Estévez-Almenzar, Marina, et al.
Published: (2025)

MemoryPods: Enhancing Asynchronous Communication in Extended Reality
by: Nagy, Akos, et al.
Published: (2025)

Can Intelligent User Interfaces Engage in Philosophical Discussions? A Longitudinal Study of Philosophers' Evolving Perceptions
by: Meng, Yibo, et al.
Published: (2025)

Does Personalized Nudging Wear Off? A Longitudinal Study of AI Self-Modeling for Behavioral Engagement
by: He, Qing, et al.
Published: (2026)

Effects of Wrist-Worn Haptic Feedback on Force Accuracy and Task Speed during a Teleoperated Robotic Surgery Task
by: Vuong, Brian B., et al.
Published: (2025)

A Novel Approach to Personalized Personality Assessment with the Attachment-Caregiving Questionnaire (ACQ): First Evidence in favor of AI-Oriented Inventory Designs
by: Gagliardi, Marcantonio, et al.
Published: (2024)

Walkthrough of Anthropomorphic Features in AI Assistant Tools
by: Maeda, Takuya
Published: (2025)

Collaborative Human-AI Risk Annotation: Co-Annotating Online Incivility with CHAIRA
by: Park, Jinkyung Katie, et al.
Published: (2024)

Does Positive Reinforcement Work?: A Quasi-Experimental Study of the Effects of Positive Feedback on Reddit
by: Lambert, Charlotte, et al.
Published: (2024)

Counting the Wait: Effects of Temporal Feedback on Downstream Task Performance and Perceived Wait-Time Experience during System-Imposed Delays
by: Tan, Felicia Fang-Yi, et al.
Published: (2026)