Imagen de Portada

Auto-BenchmarkCard: Automated Synthesis of Benchmark Documentation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hofmann, Aris, Vejsbjerg, Inge, Salwala, Dhaval, Daly, Elizabeth M.
Formato:	Preprint
Publicado:	2025
Materias:	Human-Computer Interaction Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Humble AI in the real-world: the case of algorithmic hiring
por: Nair, Rahul, et al.
Publicado: (2025)

GAF-Guard: An Agentic Framework for Risk Management and Governance in Large Language Models
por: Tirupathi, Seshu, et al.
Publicado: (2025)

A Multi-Layered Research Framework for Human-Centered AI: Defining the Path to Explainability and Trust
por: De Silva, Chameera, et al.
Publicado: (2025)

SPHERE: An Evaluation Card for Human-AI Systems
por: Ma, Qianou, et al.
Publicado: (2025)

BenchmarkCards: Standardized Documentation for Large Language Model Benchmarks
por: Sokol, Anna, et al.
Publicado: (2024)

The AI-DEC: A Card-based Design Method for User-centered AI Explanations
por: Lee, Christine P, et al.
Publicado: (2024)

MHDash: An Online Platform for Benchmarking Mental Health-Aware AI Assistants
por: Zhang, Yihe, et al.
Publicado: (2026)

OmniGUI: Benchmarking GUI Agents in Omni-Modal Smartphone Environments
por: Henry, Felix, et al.
Publicado: (2026)

GrandGuard: Taxonomy, Benchmark, and Safeguards for Elderly-Chatbot Interaction Safety
por: Fan, Changxuan, et al.
Publicado: (2026)

Generate, Evaluate, Iterate: Synthetic Data for Human-in-the-Loop Refinement of LLM Judges
por: Do, Hyo Jin, et al.
Publicado: (2025)

From LLM-Driven Trading Card Generation to Procedural Relatedness: A Pokémon Case Study
por: Pfau, Johannes, et al.
Publicado: (2026)

Language Models in Dialogue: Conversational Maxims for Human-AI Interactions
por: Miehling, Erik, et al.
Publicado: (2024)

Rethinking Theory of Mind Benchmarks for LLMs: Towards A User-Centered Perspective
por: Wang, Qiaosi, et al.
Publicado: (2025)

MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agents
por: Wang, Luyuan, et al.
Publicado: (2024)

Sycophancy is an Educational Safety Risk: Why LLM Tutors Need Sycophancy Benchmarks
por: Kasneci, Enkelejda, et al.
Publicado: (2026)

FingerTip 20K: A Benchmark for Proactive and Personalized Mobile LLM Agents
por: Yang, Qinglong, et al.
Publicado: (2025)

LibEER: A Comprehensive Benchmark and Algorithm Library for EEG-based Emotion Recognition
por: Liu, Huan, et al.
Publicado: (2024)

A Scalable Approach to Benchmarking the In-Conversation Differential Diagnostic Accuracy of a Health AI
por: Bhatt, Deep, et al.
Publicado: (2024)

IDRBench: Interactive Deep Research Benchmark
por: Feng, Yingchaojie, et al.
Publicado: (2026)

Benchmarking LLM Tool-Use in the Wild
por: Yu, Peijie, et al.
Publicado: (2026)

AutoML in The Wild: Obstacles, Workarounds, and Expectations
por: Sun, Yuan, et al.
Publicado: (2023)

MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfaces
por: Luera, Reuben A., et al.
Publicado: (2025)

Benchmarking Large Language Models for Diagnosing Students' Cognitive Skills from Handwritten Math Work
por: Kim, Yoonsu, et al.
Publicado: (2025)

Social Human Robot Embodied Conversation (SHREC) Dataset: Benchmarking Foundational Models' Social Reasoning
por: Lee, Dong Won, et al.
Publicado: (2025)

RealUserSim: Bridging the Reality Gap in Agent Benchmarking via Grounded User Simulation
por: Zhu, Ming, et al.
Publicado: (2026)

AI Risk Atlas: Taxonomy and Tooling for Navigating AI Risks and Resources
por: Bagehorn, Frank, et al.
Publicado: (2025)

Evaluating AI Alignment in LLMs: Output Analysis of Value Priorities Across 75 Models with Human Benchmarking
por: Lau, Gabriel Rongyang, et al.
Publicado: (2025)

VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics
por: Gong, Yichen, et al.
Publicado: (2026)

Towards Real-World Validity in Generative AI Benchmarks: Understanding and Designing Domain-Centered Evaluations for Journalism Practitioners
por: Li, Charlotte, et al.
Publicado: (2025)

The Role of AI in Peer Support for Young People: A Study of Preferences for Human- and AI-Generated Responses
por: Young, Jordyn, et al.
Publicado: (2024)

Benchmark It Yourself (BIY): Preparing a Dataset and Benchmarking AI Models for Scatterplot-Related Tasks
por: Palmeiro, João, et al.
Publicado: (2025)

Do LLMs Need to See Everything? A Benchmark and Study of Failures in LLM-driven Smartphone Automation using Screentext vs. Screenshots
por: Zhang, Shiquan, et al.
Publicado: (2026)

Evaluating the Prompt Steerability of Large Language Models
por: Miehling, Erik, et al.
Publicado: (2024)

Creativity Benchmark: A benchmark for marketing creativity for large language models
por: Bhat, Ninad, et al.
Publicado: (2025)

Human-Centered Automation
por: Toxtli, Carlos
Publicado: (2024)

SECURE: Benchmarking Large Language Models for Cybersecurity
por: Bhusal, Dipkamal, et al.
Publicado: (2024)

AutoS$^2$earch: Unlocking the Reasoning Potential of Large Models for Web-based Source Search
por: Zhu, Zhengqiu, et al.
Publicado: (2025)

AutoGameUI: Constructing High-Fidelity GameUI via Multimodal Correspondence Matching
por: Tang, Zhongliang, et al.
Publicado: (2024)

Automated Visualization Makeovers with LLMs
por: Gangwar, Siddharth, et al.
Publicado: (2025)

CHBench: A Cognitive Hierarchy Benchmark for Evaluating Strategic Reasoning Capability of LLMs
por: Liu, Hongtao, et al.
Publicado: (2025)