Cover Image

Orchestrating LLM Agents for Scientific Research: A Pilot Study of Multiple Choice Question (MCQ) Generation and Evaluation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	An, Yuan
Format:	Preprint
Published:	2026
Subjects:	Computers and Society Artificial Intelligence Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CODE-GEN: A Human-in-the-Loop RAG-Based Agentic AI System for Multiple-Choice Question Generation
by: Duan, Xiaojing, et al.
Published: (2026)

The Basic B*** Effect: The Use of LLM-based Agents Reduces the Distinctiveness and Diversity of People's Choices
by: Matz, Sandra C., et al.
Published: (2025)

Assessing the Prevalence of AI-assisted Cheating in Programming Courses: A Pilot Study
by: Delphino, Kaléu
Published: (2025)

Pilot Study on Generative AI and Critical Thinking in Higher Education Classrooms
by: Lamberti, W. F., et al.
Published: (2025)

Building Better AI Agents: A Provocation on the Utilisation of Persona in LLM-based Conversational Agents
by: Sun, Guangzhi, et al.
Published: (2024)

LegalWebAgent: Empowering Access to Justice via LLM-Based Web Agents
by: Tan, Jinzhe, et al.
Published: (2025)

Responding to Generative AI Technologies with Research-through-Design: The Ryelands AI Lab as an Exploratory Study
by: Benjamin, Jesse Josua, et al.
Published: (2024)

When Models Disagree: Rethinking LLM Evaluation for Public Comment Analysis
by: Najera, Aisha, et al.
Published: (2026)

Examining and Addressing Barriers to Diversity in LLM-Generated Ideas
by: Deng, Yuting, et al.
Published: (2026)

Exploring User Acceptance and Concerns toward LLM-powered Conversational Agents in Immersive Extended Reality
by: Bozkir, Efe, et al.
Published: (2025)

Exploring How Multiple Levels of GPT-Generated Programming Hints Support or Disappoint Novices
by: Xiao, Ruiwei, et al.
Published: (2024)

Who Defines "Best"? Towards Interactive, User-Defined Evaluation of LLM Leaderboards
by: Jung, Minji, et al.
Published: (2026)

From Pilots to Practices: A Scoping Review of GenAI-Enabled Personalization in Computer Science Education
by: Reihanian, Iman, et al.
Published: (2025)

Generating the Modal Worker: A Cross-Model Audit of Race and Gender in LLM-Generated Personas Across 41 Occupations
by: van der Linden, Ilona, et al.
Published: (2025)

Longitudinal Study on Social and Emotional Use of AI Conversational Agent
by: Chandra, Mohit, et al.
Published: (2025)

Multi-Agent Comedy Club: Investigating Community Discussion Effects on LLM Humor Generation
by: Hong, Shiwei, et al.
Published: (2026)

AI and Consciousness: Shifting Focus Towards Tractable Questions
by: Comsa, Iulia-Maria
Published: (2026)

A Study about Distribution and Acceptance of Conversational Agents for Mental Health in Germany: Keep the Human in the Loop?
by: Lukas, Christina
Published: (2025)

LLM Agents for Education: Advances and Applications
by: Chu, Zhendong, et al.
Published: (2025)

Who's Asking? Simulating Role-Based Questions for Conversational AI Evaluation
by: Kaur, Navreet, et al.
Published: (2025)

Evaluating Contextually Personalized Programming Exercises Created with Generative AI
by: Logacheva, Evanfiya, et al.
Published: (2024)

The Impact of Big Five Personality Traits on AI Agent Decision-Making in Public Spaces: A Social Simulation Study
by: Ren, Mingjun, et al.
Published: (2025)

How to Capture and Study Conversations Between Research Participants and ChatGPT: GPT for Researchers (g4r.org)
by: Kim, Jin
Published: (2025)

Evaluating Generative AI as an Educational Tool for Radiology Resident Report Drafting
by: Verdone, Antonio, et al.
Published: (2025)

Comparing LLM-Based Conversational and Graphical Interfaces for Industrial Decision Tasks: An Exploratory Mixed-Methods Study
by: Figliè, Roberto, et al.
Published: (2026)

The RIGID Framework: Research-Integrated, Generative AI-Mediated Instructional Design
by: Kwak, Yerin, et al.
Published: (2026)

Addressing Bias in Generative AI: Challenges and Research Opportunities in Information Management
by: Wei, Xiahua, et al.
Published: (2025)

LLM BiasScope: A Real-Time Bias Analysis Platform for Comparative LLM Evaluation
by: Ghosh, Himel, et al.
Published: (2026)

A Comparative Study of Technical Writing Feedback Quality: Evaluating LLMs, SLMs, and Humans in Computer Science Topics
by: Liu, Suqing, et al.
Published: (2025)

AgentSUMO: An Agentic Framework for Interactive Simulation Scenario Generation in SUMO via Large Language Models
by: Jeong, Minwoo, et al.
Published: (2025)

Investigating Collaborative Data Practices: a Case Study on Artificial Intelligence for Healthcare Research
by: Henkin, Rafael, et al.
Published: (2023)

Exploring Human-AI Collaboration Using Mental Models of Early Adopters of Multi-Agent Generative AI Tools
by: Naik, Suchismita, et al.
Published: (2025)

Would You Rely on an Eerie Agent? A Systematic Review of the Impact of the Uncanny Valley Effect on Trust in Human-Agent Interaction
by: Alipour, Ahdiyeh, et al.
Published: (2025)

WaLLM -- Insights from an LLM-Powered Chatbot deployment via WhatsApp
by: Eltigani, Hiba, et al.
Published: (2025)

Exploring Communication Strategies for Collaborative LLM Agents in Mathematical Problem-Solving
by: Zhang, Liang, et al.
Published: (2025)

Enhancing Selection of Climate Tech Startups with AI -- A Case Study on Integrating Human and AI Evaluations in the ClimaTech Great Global Innovation Challenge
by: Turliuk, Jennifer, et al.
Published: (2025)

LLM Social Simulations Are a Promising Research Method
by: Anthis, Jacy Reese, et al.
Published: (2025)

From Prompts to Constructs: A Dual-Validity Framework for LLM Research in Psychology
by: Lin, Zhicheng
Published: (2025)

Social Welfare Function Leaderboard: When LLM Agents Allocate Social Welfare
by: Shi, Zhengliang, et al.
Published: (2025)

A Meta-Analysis of LLM Effects on Students across Qualification, Socialisation, and Subjectification
by: Huang, Jiayu, et al.
Published: (2025)