Imagen de Portada

Audit Me If You Can: Query-Efficient Active Fairness Auditing of Black-Box LLMs

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hartmann, David, Pohlmann, Lena, Hanslik, Lelia, Gießing, Noah, Berendt, Bettina, Delobelle, Pieter
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Computation and Language Computers and Society
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Human-Centred LLM Privacy Audits: Findings and Frictions
por: Staufer, Dimitri, et al.
Publicado: (2026)

A Systematic Review of Echo Chamber Research: Comparative Analysis of Conceptualizations, Operationalizations, and Varying Outcomes
por: Hartmann, David, et al.
Publicado: (2024)

Watching the Watchers: A Comparative Fairness Audit of Cloud-based Content Moderation Services
por: Hartmann, David, et al.
Publicado: (2024)

Black-Box Access is Insufficient for Rigorous AI Audits
por: Casper, Stephen, et al.
Publicado: (2024)

White-Box Sensitivity Auditing with Steering Vectors
por: Cyberey, Hannah, et al.
Publicado: (2026)

Auditing LLMs for Algorithmic Fairness in Casenote-Augmented Tabular Prediction
por: Lee, Xiao Qi, et al.
Publicado: (2026)

Can AI be Auditable?
por: Verma, Himanshu, et al.
Publicado: (2025)

What Do LLMs Associate with Your Name? A Human-Centered Black-Box Audit of Personal Data
por: Staufer, Dimitri, et al.
Publicado: (2026)

Leveraging Imperfect Sources to Detect Fairwashing in Black-Box Auditing
por: Bourrée, Jade Garcia, et al.
Publicado: (2023)

Distribution-Specific Auditing For Subgroup Fairness
por: Hsu, Daniel, et al.
Publicado: (2024)

Addressing the regulatory gap: moving towards an EU AI audit ecosystem beyond the AI Act by including civil society
por: Hartmann, David, et al.
Publicado: (2024)

Cost Efficient Fairness Audit Under Partial Feedback
por: Das, Nirjhar, et al.
Publicado: (2025)

Auditing Fairness by Betting
por: Chugg, Ben, et al.
Publicado: (2023)

Auditing Fairness under Unobserved Confounding
por: Byun, Yewon, et al.
Publicado: (2024)

AuditMAI: Towards An Infrastructure for Continuous AI Auditing
por: Waltersdorfer, Laura, et al.
Publicado: (2024)

The Silicon Ceiling: Auditing GPT's Race and Gender Biases in Hiring
por: Armstrong, Lena, et al.
Publicado: (2024)

Ensuring Fairness with Transparent Auditing of Quantitative Bias in AI Systems
por: Yuan, Chih-Cheng Rex, et al.
Publicado: (2024)

Fairness Audits of Institutional Risk Models in Deployed ML Pipelines
por: McConvey, Kelly, et al.
Publicado: (2026)

Peer-induced Fairness: A Causal Approach for Algorithmic Fairness Auditing
por: Fang, Shiqi, et al.
Publicado: (2024)

Auditing Yelp's Business Ranking and Review Recommendation Through the Lens of Fairness
por: Singhal, Mohit, et al.
Publicado: (2023)

FALE: Fairness-Aware ALE Plots for Auditing Bias in Subgroups
por: Giannopoulos, Giorgos, et al.
Publicado: (2024)

Explainability Auditing for Intelligent Systems: A Rationale for Multi-Disciplinary Perspectives
por: Langer, Markus, et al.
Publicado: (2021)

Group Fairness Meets the Black Box: Enabling Fair Algorithms on Closed LLMs via Post-Processing
por: Xian, Ruicheng, et al.
Publicado: (2025)

Bias Similarity Measurement: A Black-Box Audit of Fairness Across LLMs
por: Jeong, Hyejun, et al.
Publicado: (2024)

Impact Matters! An Audit Method to Evaluate AI Projects and their Impact for Sustainability and Public Interest
por: Züger, Theresa, et al.
Publicado: (2026)

AuditWen:An Open-Source Large Language Model for Audit
por: Huang, Jiajia, et al.
Publicado: (2024)

When LLMs Imagine People: A Human-Centered Persona Brainstorm Audit for Bias and Fairness in Creative Applications
por: Cao, Hongliu, et al.
Publicado: (2026)

Auditing Agent Harness Safety
por: Liu, Chengzhi, et al.
Publicado: (2026)

AuditGPT: Auditing Smart Contracts with ChatGPT
por: Xia, Shihao, et al.
Publicado: (2024)

Silencing the Risk, Not the Whistle: A Semi-automated Text Sanitization Tool for Mitigating the Risk of Whistleblower Re-Identification
por: Staufer, Dimitri, et al.
Publicado: (2024)

Nishpaksh: TEC Standard-Compliant Framework for Fairness Auditing and Certification of AI Models
por: Prakash, Shashank, et al.
Publicado: (2026)

The Fair Game: Auditing & Debiasing AI Algorithms Over Time
por: Basu, Debabrota, et al.
Publicado: (2025)

Investigating Youth AI Auditing
por: Solyst, Jaemarie, et al.
Publicado: (2025)

Quantitative Auditing of AI Fairness with Differentially Private Synthetic Data
por: Yuan, Chih-Cheng Rex, et al.
Publicado: (2025)

Auditing Stance Asymmetry in Generative Explanations
por: Han, Jiarui
Publicado: (2026)

Sublinear Algorithms for Wasserstein and Total Variation Distances: Applications to Fairness and Privacy Auditing
por: Basu, Debabrota, et al.
Publicado: (2025)

Auditing the Reliability of Multimodal Generative Search
por: Sahneh, Erfan Samieyan, et al.
Publicado: (2026)

Audit Cards: Contextualizing AI Evaluations
por: Staufer, Leon, et al.
Publicado: (2025)

Auditing for Human Expertise
por: Alur, Rohan, et al.
Publicado: (2023)

Auditing the Fairness of the US COVID-19 Forecast Hub's Case Prediction Models
por: Abrar, Saad Mohammad, et al.
Publicado: (2024)