Cover Image

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Eriksson, Maria, Purificato, Erasmo, Noroozian, Arman, Vinagre, Joao, Chaslot, Guillaume, Gomez, Emilia, Fernandez-Llorca, David
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence I.2.0; A.1
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AI
by: de Cerqueira, José Antonio Siqueira, et al.
Published: (2024)

Generative AI and the Future of the Digital Commons: Five Open Questions and Knowledge Gaps
by: Noroozian, Arman, et al.
Published: (2025)

Trusting AI in High-stake Decision Making
by: Saffarini, Ali
Published: (2023)

Amazon Nova AI Challenge -- Trusted AI: Advancing secure, AI-assisted software development
by: Sahai, Sattvik, et al.
Published: (2025)

Seeing The Words: Evaluating AI-generated Biblical Art
by: Makimei, Hidde, et al.
Published: (2025)

Benchmarking AI for low-resource contexts: Thinking beyond leaderboards
by: Pant, Aakash, et al.
Published: (2026)

Towards Friendly AI: A Comprehensive Review and New Perspectives on Human-AI Alignment
by: Sun, Qiyang, et al.
Published: (2024)

The Station: An Open-World Environment for AI-Driven Discovery
by: Chung, Stephen, et al.
Published: (2025)

Quaternion Convolutional Neural Networks: Current Advances and Future Directions
by: Altamirano-Gomez, Gerardo, et al.
Published: (2023)

Threats and Opportunities in AI-generated Images for Armed Forces
by: Meier, Raphael
Published: (2025)

Making High-Level AI Design Decisions Explicit Using a Binary Stream System-Designation Approach
by: Mossbridge, Julia
Published: (2024)

OpenAI Cribbed Our Tax Example, But Can GPT-4 Really Do Tax?
by: Blair-Stanek, Andrew, et al.
Published: (2023)

Diverse AI Personas Can Mitigate the Homogenization Effect in Human-AI Collaborative Ideation
by: Wan, Yun, et al.
Published: (2025)

FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare
by: Lekadir, Karim, et al.
Published: (2023)

The Landscape of Generative AI in Information Systems: A Synthesis of Secondary Reviews and Research Agendas
by: Jarzębowicz, Aleksander, et al.
Published: (2026)

Synthetic Photography Detection: A Visual Guidance for Identifying Synthetic Images Created by AI
by: Mathys, Melanie, et al.
Published: (2024)

Antagonistic AI
by: Cai, Alice, et al.
Published: (2024)

A Framework for Responsible AI Systems: Building Societal Trust through Domain Definition, Trustworthy AI Design, Auditability, Accountability, and Governance
by: Herrera-Poyatos, Andrés, et al.
Published: (2025)

Evaluating Large Language Models for Causal Modeling
by: Razouk, Houssam, et al.
Published: (2024)

Attack Selection Reduces Safety in Concentrated AI Control Settings against Trusted Monitoring
by: Schaeffer, Joachim, et al.
Published: (2026)

We Need a New Ethics for a World of AI Agents
by: Gabriel, Iason, et al.
Published: (2025)

Moral Responsibility or Obedience: What Do We Want from AI?
by: Boland, Joseph
Published: (2025)

Data Feminism for AI
by: Klein, Lauren, et al.
Published: (2024)

Developing trustworthy AI applications with foundation models
by: Mock, Michael, et al.
Published: (2024)

ETOM: A Five-Level Benchmark for Evaluating Tool Orchestration within the MCP Ecosystem
by: Dong, Jia-Kai, et al.
Published: (2025)

Right-to-Act: A Pre-Execution Non-Compensatory Decision Protocol for AI Systems
by: Lavi, Gadi
Published: (2026)

AI for All: Identifying AI incidents Related to Diversity and Inclusion
by: Shams, Rifat Ara, et al.
Published: (2024)

Augmenting deep neural networks with symbolic knowledge: Towards trustworthy and interpretable AI for education
by: Hooshyar, Danial, et al.
Published: (2023)

AI Literacy in K-12 and Higher Education in the Wake of Generative AI: An Integrative Review
by: Gu, Xingjian, et al.
Published: (2025)

Event-based Solutions for Human-centered Applications: A Comprehensive Review
by: Adra, Mira, et al.
Published: (2025)

What Does 'Human-Centred AI' Mean?
by: Guest, Olivia
Published: (2025)

Provocations from the Humanities for Generative AI Research
by: Klein, Lauren, et al.
Published: (2025)

SIDEs: Separating Idealization from Deceptive Explanations in xAI
by: Sullivan, Emily
Published: (2024)

CURATe: Benchmarking Personalised Alignment of Conversational AI Assistants
by: Alberts, Lize, et al.
Published: (2024)

Fanar: An Arabic-Centric Multimodal Generative AI Platform
by: Fanar Team, et al.
Published: (2025)

Reward is not enough: can we liberate AI from the reinforcement learning paradigm?
by: Glukhov, Vacslav
Published: (2022)

A Review of Pseudo-Labeling for Computer Vision
by: Kage, Patrick, et al.
Published: (2024)

Rip Current Segmentation: A Novel Benchmark and YOLOv8 Baseline Results
by: Dumitriu, Andrei, et al.
Published: (2025)

Evaluating AI-Enabled deception vulnerability amongst Sub-Saharan-Africa migrants
by: Oluwasanya, Deborah
Published: (2026)

AI and the Problem of Knowledge Collapse
by: Peterson, Andrew J.
Published: (2024)