Copertina

Who Defines "Best"? Towards Interactive, User-Defined Evaluation of LLM Leaderboards

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Jung, Minji, Lee, Minjae, Kim, Yejin, Choi, Sarang, Kahng, Minsuk
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Artificial Intelligence Computers and Society Human-Computer Interaction
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Data-Prompt Co-Evolution: Growing Test Sets to Refine LLM Behavior
di: Lee, Minjae, et al.
Pubblicazione: (2025)

EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria
di: Kim, Tae Soo, et al.
Pubblicazione: (2023)

Understanding the Dataset Practitioners Behind Large Language Model Development
di: Qian, Crystal, et al.
Pubblicazione: (2024)

Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South
di: Rastogi, Charvi, et al.
Pubblicazione: (2026)

Social Welfare Function Leaderboard: When LLM Agents Allocate Social Welfare
di: Shi, Zhengliang, et al.
Pubblicazione: (2025)

Defining AI Fatigue in Academic Contexts: Dimensions, Indicators, and a Stage-Based Model Using Grounded Theory
di: Miranda, John Paul P., et al.
Pubblicazione: (2026)

Automatic Histograms: Leveraging Language Models for Text Dataset Exploration
di: Reif, Emily, et al.
Pubblicazione: (2024)

LLM Attributor: Interactive Visual Attribution for LLM Generation
di: Lee, Seongmin, et al.
Pubblicazione: (2024)

Who's Asking? Simulating Role-Based Questions for Conversational AI Evaluation
di: Kaur, Navreet, et al.
Pubblicazione: (2025)

Position on LLM-Assisted Peer Review: Addressing Reviewer Gap through Mentoring and Feedback
di: Yun, JungMin, et al.
Pubblicazione: (2026)

LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Models
di: Kahng, Minsuk, et al.
Pubblicazione: (2024)

U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planning
di: Lee, Christine P, et al.
Pubblicazione: (2026)

Interactive Prompt Debugging with Sequence Salience
di: Tenney, Ian, et al.
Pubblicazione: (2024)

Tinker Tales: Interactive Storytelling Framework for Early Childhood Narrative Development and AI Literacy
di: Choi, Nayoung, et al.
Pubblicazione: (2025)

The Who in XAI: How AI Background Shapes Perceptions of AI Explanations
di: Ehsan, Upol, et al.
Pubblicazione: (2021)

Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluations
di: Seshadri, Preethi, et al.
Pubblicazione: (2026)

Investigating Thematic Patterns and User Preferences in LLM Interactions using BERTopic
di: Bhandarkar, Abhay, et al.
Pubblicazione: (2025)

Who's in Charge? Disempowerment Patterns in Real-World LLM Usage
di: Sharma, Mrinank, et al.
Pubblicazione: (2026)

Towards User-Centred Design of AI-Assisted Decision-Making in Law Enforcement
di: Nowack, Vesna, et al.
Pubblicazione: (2025)

Exploring User Acceptance and Concerns toward LLM-powered Conversational Agents in Immersive Extended Reality
di: Bozkir, Efe, et al.
Pubblicazione: (2025)

Towards an LLM-powered Social Digital Twinning Platform
di: Gürcan, Önder, et al.
Pubblicazione: (2025)

Towards Synergistic Teacher-AI Interactions with Generative Artificial Intelligence
di: Cukurova, Mutlu, et al.
Pubblicazione: (2025)

Provocation: Who benefits from "inclusion" in Generative AI?
di: Dalal, Samantha, et al.
Pubblicazione: (2024)

Beyond Technocratic XAI: The Who, What & How in Explanation Design
di: Dhar, Ruchira, et al.
Pubblicazione: (2025)

The Evolution of LLM Adoption in Industry Data Curation Practices
di: Qian, Crystal, et al.
Pubblicazione: (2024)

Towards Apples to Apples for AI Evaluations: From Real-World Use Cases to Evaluation Scenarios
di: Choong, Yee-Yin, et al.
Pubblicazione: (2026)

How Users Who are Blind or Low Vision Play Mobile Games: Perceptions, Challenges, and Strategies
di: Ran, Zihe, et al.
Pubblicazione: (2025)

Towards Ethical Personal AI Applications: Practical Considerations for AI Assistants with Long-Term Memory
di: Lee, Eunhae
Pubblicazione: (2024)

When Models Disagree: Rethinking LLM Evaluation for Public Comment Analysis
di: Najera, Aisha, et al.
Pubblicazione: (2026)

Generative AI Literacy: Twelve Defining Competencies
di: Annapureddy, Ravinithesh, et al.
Pubblicazione: (2024)

Avenir-UX: Automated UX Evaluation via Simulated Human Web Interaction with GUI Grounding
di: Tan, Wee Joe, et al.
Pubblicazione: (2026)

Orchestrating LLM Agents for Scientific Research: A Pilot Study of Multiple Choice Question (MCQ) Generation and Evaluation
di: An, Yuan
Pubblicazione: (2026)

The Impacts of AI Avatar Appearance and Disclosure on User Motivation
di: Visser, Boele, et al.
Pubblicazione: (2024)

A Checklist for Trustworthy, Safe, and User-Friendly Mental Health Chatbots
di: Haran, Shreya, et al.
Pubblicazione: (2026)

Generative AI User Experience: Developing Human--AI Epistemic Partnership
di: Zhai, Xiaoming
Pubblicazione: (2026)

Imperfectly Cooperative Human-AI Interactions: Comparing the Impacts of Human and AI Attributes in Simulated and User Studies
di: Cohen, Myke C., et al.
Pubblicazione: (2026)

What Is Required for Empathic AI? It Depends, and Why That Matters for AI Developers and Users
di: Borg, Jana Schaich, et al.
Pubblicazione: (2024)

WaLLM -- Insights from an LLM-Powered Chatbot deployment via WhatsApp
di: Eltigani, Hiba, et al.
Pubblicazione: (2025)

The Imbalanced User-AI Relationships as an Ethical Failure of Front-End Design in Healthcare AI
di: Mwadime, Maureen Mghambi
Pubblicazione: (2026)

From Sea to System: Exploring User-Centered Explainable AI for Maritime Decision Support
di: Jirak, Doreen, et al.
Pubblicazione: (2025)