Imagen de Portada

Keeping Up with the Language Models: Systematic Benchmark Extension for Bias Auditing

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Baldini, Ioana, Yadav, Chhavi, Nagireddy, Manish, Das, Payel, Varshney, Kush R.
Formato:	Preprint
Publicado:	2023
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Value Alignment from Unstructured Text
por: Padhi, Inkit, et al.
Publicado: (2024)

An Annotated Reading of 'The Singer of Tales' in the LLM Era
por: Varshney, Kush R.
Publicado: (2025)

Evaluating Deep Unlearning in Large Language Models
por: Wu, Ruihan, et al.
Publicado: (2024)

Alignment Studio: Aligning Large Language Models to Particular Contextual Regulations
por: Achintalwar, Swapnaja, et al.
Publicado: (2024)

Contextual Moral Value Alignment Through Context-Based Aggregation
por: Dognin, Pierre, et al.
Publicado: (2024)

Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams
por: Kim, Jiyeon, et al.
Publicado: (2026)

When in Doubt, Cascade: Towards Building Efficient and Capable Guardrails
por: Nagireddy, Manish, et al.
Publicado: (2024)

Language Models in Dialogue: Conversational Maxims for Human-AI Interactions
por: Miehling, Erik, et al.
Publicado: (2024)

Automated Concept Discovery for LLM-as-a-Judge Preference Analysis
por: Wedgwood, James, et al.
Publicado: (2026)

Empathy and the Right to Be an Exception: What LLMs Can and Cannot Do
por: Kidder, William, et al.
Publicado: (2024)

Down the Toxicity Rabbit Hole: A Novel Framework to Bias Audit Large Language Models
por: Dutta, Arka, et al.
Publicado: (2023)

Automated Benchmark Auditing for AI Agents and Large Language Models
por: Wang, Junlin, et al.
Publicado: (2026)

Fundamental Safety-Capability Trade-offs in Fine-tuning Large Language Models
por: Chen, Pin-Yu, et al.
Publicado: (2025)

Systematic Offensive Stereotyping (SOS) Bias in Language Models
por: Elsafoury, Fatma
Publicado: (2023)

Needle in the Haystack for Memory Based Large Language Models
por: Nelson, Elliot, et al.
Publicado: (2024)

Don't Change My View: Ideological Bias Auditing in Large Language Models
por: Kröger, Paul, et al.
Publicado: (2025)

Can We Infer Confidential Properties of Training Data from LLMs?
por: Huang, Pengrun, et al.
Publicado: (2025)

Segmentation Beyond Defaults: Asymmetrical Byte Pair Encoding for Optimal Machine Translation Performance
por: Yadav, Saumitra, et al.
Publicado: (2025)

Get away with less: Need of source side data curation to build parallel corpus for low resource Machine Translation
por: Yadav, Saumitra, et al.
Publicado: (2026)

Social Bias Probing: Fairness Benchmarking for Language Models
por: Manerba, Marta Marchiori, et al.
Publicado: (2023)

Transformer-based Causal Language Models Perform Clustering
por: Wu, Xinbo, et al.
Publicado: (2024)

Scopes of Alignment
por: Varshney, Kush R., et al.
Publicado: (2025)

Decolonial AI Alignment: Openness, Viśe\d{s}a-Dharma, and Including Excluded Knowledges
por: Varshney, Kush R.
Publicado: (2023)

What's in a Name? Auditing Large Language Models for Race and Gender Bias
por: Salinas, Alejandro, et al.
Publicado: (2024)

Signal or Noise? Evaluating Large Language Models in Resume Screening Across Contextual Variations and Human Expert Benchmarks
por: Varshney, Aryan, et al.
Publicado: (2025)

CLIMB: A Benchmark of Clinical Bias in Large Language Models
por: Zhang, Yubo, et al.
Publicado: (2024)

Political Alignment in Large Language Models: A Multidimensional Audit of Psychometric Identity and Behavioral Bias
por: Sakhawat, Adib, et al.
Publicado: (2026)

Can Memory-Augmented Language Models Generalize on Reasoning-in-a-Haystack Tasks?
por: Das, Payel, et al.
Publicado: (2025)

Why Don't Prompt-Based Fairness Metrics Correlate?
por: Zayed, Abdelrahman, et al.
Publicado: (2024)

Multi-Level Explanations for Generative Language Models
por: Paes, Lucas Monteiro, et al.
Publicado: (2024)

BioMamba: Domain-Adaptive Biomedical Language Models
por: Yue, Ling, et al.
Publicado: (2024)

Robust Bias Evaluation with FilBBQ: A Filipino Bias Benchmark for Question-Answering Language Models
por: Gamboa, Lance Calvin Lim, et al.
Publicado: (2026)

Keep Security! Benchmarking Security Policy Preservation in Large Language Model Contexts Against Indirect Attacks in Question Answering
por: Chang, Hwan, et al.
Publicado: (2025)

TuneVLSeg: Prompt Tuning Benchmark for Vision-Language Segmentation Models
por: Adhikari, Rabin, et al.
Publicado: (2024)

Generation Constraint Scaling Can Mitigate Hallucination
por: Kollias, Georgios, et al.
Publicado: (2024)

A Meta-Learning Perspective on Transformers for Causal Language Modeling
por: Wu, Xinbo, et al.
Publicado: (2023)

Zero-Shot Grammar Competency Estimation Using Large Language Model Generated Pseudo Labels
por: Das, Sourya Dipta, et al.
Publicado: (2025)

BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culture
por: Ridoy, Shahriyar Zaman, et al.
Publicado: (2025)

NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models
por: Dhurandhar, Amit, et al.
Publicado: (2024)

debiaSAE: Benchmarking and Mitigating Vision-Language Model Bias
por: Sasse, Kuleen, et al.
Publicado: (2024)