Imagen de Portada

LLMAuditor: A Framework for Auditing Large Language Models Using Human-in-the-Loop

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Amirizaniani, Maryam, Yao, Jihan, Lavergne, Adrian, Okada, Elizabeth Snell, Chadha, Aman, Roosta, Tanya, Shah, Chirag
Formato:	Preprint
Publicado:	2024
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

AuditLLM: A Tool for Auditing Large Language Models Using Multiprobe Approach
por: Amirizaniani, Maryam, et al.
Publicado: (2024)

How Well Do LLMs Represent Values Across Cultures? Empirical Analysis of LLM Responses Based on Hofstede Cultural Dimensions
por: Kharchenko, Julia, et al.
Publicado: (2024)

I Think, Therefore I Am Under-Qualified? A Benchmark for Evaluating Linguistic Shibboleth Detection in LLM Hiring Evaluations
por: Kharchenko, Julia, et al.
Publicado: (2025)

Do LLMs Exhibit Human-Like Reasoning? Evaluating Theory of Mind in LLMs for Open-Ended Responses
por: Amirizaniani, Maryam, et al.
Publicado: (2024)

From Prompt Engineering to Prompt Science With Human in the Loop
por: Shah, Chirag
Publicado: (2024)

Rudder: Steering Prefetching in Distributed GNN Training using LLM Agents
por: Sarkar, Aishwarya, et al.
Publicado: (2026)

Are Small Language Models Ready to Compete with Large Language Models for Practical Applications?
por: Sinha, Neelabh, et al.
Publicado: (2024)

ClaimVer: Explainable Claim-Level Verification and Evidence Attribution of Text Through Knowledge Graphs
por: Dammu, Preetam Prabhu Srikar, et al.
Publicado: (2024)

Learning to Reason for Multi-Step Retrieval of Personal Context in Personalized Question Answering
por: Amirizaniani, Maryam, et al.
Publicado: (2026)

Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive Principles
por: Budagam, Devichand, et al.
Publicado: (2024)

Reasoning or Rhetoric? An Empirical Analysis of Moral Reasoning Explanations in Large Language Models
por: Kasat, Aryan, et al.
Publicado: (2026)

Exploring the Impact of Large Language Models on Recommender Systems: An Extensive Review
por: Vats, Arpita, et al.
Publicado: (2024)

Born With a Silver Spoon? Investigating Socioeconomic Bias in Large Language Models
por: Singh, Smriti, et al.
Publicado: (2024)

Human-Readable Adversarial Prompts: An Investigation into LLM Vulnerabilities Using Situational Context
por: Das, Nilanjana, et al.
Publicado: (2024)

Can Large Language Models Infer Causal Relationships from Real-World Text?
por: Saklad, Ryan, et al.
Publicado: (2025)

iAgentBench: Benchmarking Sensemaking Capabilities of Information-Seeking Agents on High-Traffic Topics
por: Dammu, Preetam Prabhu Srikar, et al.
Publicado: (2026)

A Comprehensive Survey of Accelerated Generation Techniques in Large Language Models
por: Khoshnoodi, Mahsa, et al.
Publicado: (2024)

AlignMerge - Alignment-Preserving Large Language Model Merging via Fisher-Guided Geometric Constraints
por: Roy, Aniruddha, et al.
Publicado: (2025)

Efficient and Responsible Adaptation of Large Language Models for Robust and Equitable Top-k Recommendations
por: Kaur, Kirandeep, et al.
Publicado: (2025)

Property-guided Inverse Design of Metal-Organic Frameworks Using Quantum Natural Language Processing
por: Kang, Shinyoung, et al.
Publicado: (2024)

Guiding Vision-Language Model Selection for Visual Question-Answering Across Tasks, Domains, and Knowledge Types
por: Sinha, Neelabh, et al.
Publicado: (2024)

Training LLMs with Reinforcement Learning for Intent-Aware Personalized Question Answering
por: Amirizaniani, Maryam, et al.
Publicado: (2026)

From Fog to Failure: The Unintended Consequences of Dehazing on Object Detection in Clear Images
por: Kumar, Ashutosh, et al.
Publicado: (2025)

IndicMMLU-Pro: Benchmarking Indic Large Language Models on Multi-Task Language Understanding
por: KJ, Sankalp, et al.
Publicado: (2025)

Density Adaptive Attention-based Speech Network: Enhancing Feature Understanding for Mental Health Disorders
por: Ioannides, Georgios, et al.
Publicado: (2024)

Generative Data Augmentation using LLMs improves Distributional Robustness in Question Answering
por: Chowdhury, Arijit Ghosh, et al.
Publicado: (2023)

An Unsupervised Anomaly Detection in Electricity Consumption Using Reinforcement Learning and Time Series Forest Based Framework
por: Ghanim, Jihan, et al.
Publicado: (2024)

A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications
por: Sahoo, Pranab, et al.
Publicado: (2024)

Multilingual State Space Models for Structured Question Answering in Indic Languages
por: Vats, Arpita, et al.
Publicado: (2025)

How Culturally Aware are Vision-Language Models?
por: Burda-Lassen, Olena, et al.
Publicado: (2024)

Potential and Perils of Large Language Models as Judges of Unstructured Textual Data
por: Bedemariam, Rewina, et al.
Publicado: (2025)

On the Feasibility of Vision-Language Models for Time-Series Classification
por: Prithyani, Vinay, et al.
Publicado: (2024)

TRACEALIGN -- Tracing the Drift: Attributing Alignment Failures to Training-Time Belief Sources in LLMs
por: Das, Amitava, et al.
Publicado: (2025)

TRUST: A Decentralized Framework for Auditing Large Language Model Reasoning
por: Huang, Morris Yu-Chao, et al.
Publicado: (2025)

On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language Models
por: Wijesiriwardene, Thilini, et al.
Publicado: (2023)

Simulating Meaning, Nevermore! Introducing ICR: A Semiotic-Hermeneutic Metric for Evaluating Meaning in LLM Text Summaries
por: Perez, Natalie, et al.
Publicado: (2026)

Neural FOXP2 -- Language Specific Neuron Steering for Targeted Language Improvement in LLMs
por: Saha, Anusa, et al.
Publicado: (2026)

A Comprehensive Survey of Hallucination in Large Language, Image, Video and Audio Foundation Models
por: Sahoo, Pranab, et al.
Publicado: (2024)

Importance Sampling for Nonlinear Models
por: Rajmohan, Prakash Palanivelu, et al.
Publicado: (2025)

Exploring the Frontier of Vision-Language Models: A Survey of Current Methodologies and Future Directions
por: Ghosh, Akash, et al.
Publicado: (2024)