Cover Image

VIGNETTE: Socially Grounded Bias Evaluation for Vision-Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Raj, Chahat, Wei, Bowen, Caliskan, Aylin, Anastasopoulos, Antonios, Zhu, Ziwei
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

BiasDora: Exploring Hidden Biased Associations in Vision-Language Models
by: Raj, Chahat, et al.
Published: (2024)

Breaking Bias, Building Bridges: Evaluation and Mitigation of Social Biases in LLMs via Contact Hypothesis
by: Raj, Chahat, et al.
Published: (2024)

Talent or Luck? Evaluating Attribution Bias in Large Language Models
by: Raj, Chahat, et al.
Published: (2025)

What's Not Said Still Hurts: A Description-Based Evaluation Framework for Measuring Social Bias in LLMs
by: Pan, Jinhao, et al.
Published: (2025)

Bias Association Discovery Framework for Open-Ended LLM Generations
by: Pan, Jinhao, et al.
Published: (2025)

Metadata Conditioned Large Language Models for Localization
by: Mukherjee, Anjishnu, et al.
Published: (2026)

Crossroads of Continents: Automated Artifact Extraction for Cultural Adaptation with Large Multimodal Models
by: Mukherjee, Anjishnu, et al.
Published: (2024)

Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrieval
by: Wilson, Kyra, et al.
Published: (2024)

Purdah and Patriarchy: Evaluating and Mitigating South Asian Biases in Open-Ended Multilingual LLM Generations
by: Rinki, Mamnuya, et al.
Published: (2025)

Identifying Features Associated with Bias Against 93 Stigmatized Groups in Language Models and Guardrail Model Safety Mitigation
by: Gueorguieva, Anna-Maria, et al.
Published: (2025)

An Efficient Approach for Studying Cross-Lingual Transfer in Multilingual Language Models
by: Faisal, Fahim, et al.
Published: (2024)

ChatGPT Perpetuates Gender Bias in Machine Translation and Ignores Non-Gendered Pronouns: Findings across Bengali and Five other Low-Resource Languages
by: Ghosh, Sourojit, et al.
Published: (2023)

mHumanEval -- A Multilingual Benchmark to Evaluate Large Language Models for Code Generation
by: Raihan, Nishat, et al.
Published: (2024)

Dialect Normalization using Large Language Models and Morphological Rules
by: Dimakis, Antonios, et al.
Published: (2025)

A Taxonomy of Stereotype Content in Large Language Models
by: Nicolas, Gandalf, et al.
Published: (2024)

Speaking of Language: Reflections on Metalanguage Research in NLP
by: Schneider, Nathan, et al.
Published: (2026)

Dialectal Toxicity Detection: Evaluating LLM-as-a-Judge Consistency Across Language Varieties
by: Faisal, Fahim, et al.
Published: (2024)

Biases Propagate in Encoder-based Vision-Language Models: A Systematic Analysis From Intrinsic Measures to Zero-shot Retrieval Outcomes
by: Ghate, Kshitish, et al.
Published: (2025)

Script-Agnostic Language Identification
by: Agarwal, Milind, et al.
Published: (2024)

GMU Systems for the IWSLT 2025 Low-Resource Speech Translation Shared Task
by: Meng, Chutong, et al.
Published: (2025)

Back to School: Translation Using Grammar Books
by: Hus, Jonathan, et al.
Published: (2024)

Data-Augmentation-Based Dialectal Adaptation for LLMs
by: Faisal, Fahim, et al.
Published: (2024)

A Study on Scaling Up Multilingual News Framing Analysis
by: Akter, Syeda Sabrina, et al.
Published: (2024)

Safe Language Generation in the Limit
by: Anastasopoulos, Antonios, et al.
Published: (2026)

CODET: A Benchmark for Contrastive Dialectal Evaluation of Machine Translation
by: Alam, Md Mahfuz Ibn, et al.
Published: (2023)

Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label Smoothing
by: Fayyazsanavi, Pooya, et al.
Published: (2024)

Mitigating Hallucination in Large Vision-Language Models via Adaptive Attention Calibration
by: Fazli, Mehrdad, et al.
Published: (2025)

Persona-Assigned Large Language Models Exhibit Human-Like Motivated Reasoning
by: Dash, Saloni, et al.
Published: (2025)

Developing a Mixed-Methods Pipeline for Community-Oriented Digitization of Kwak'wala Legacy Texts
by: Agarwal, Milind, et al.
Published: (2025)

Cross-Lingual Representation Alignment Through Contrastive Image-Caption Tuning
by: Krasner, Nathaniel, et al.
Published: (2025)

Automated Python Translation
by: Otten, Joshua, et al.
Published: (2025)

TigerCoder: A Novel Suite of LLMs for Code Generation in Bangla
by: Raihan, Nishat, et al.
Published: (2025)

A Case Study on Filtering for End-to-End Speech Translation
by: Alam, Md Mahfuz Ibn, et al.
Published: (2024)

Lost in the Tower of Babel: The Adverse Effects of Incidental Multilingualism in LLMs
by: Mukherjee, Anjishnu, et al.
Published: (2026)

Urban Mobility Assessment Using LLMs
by: Bhandari, Prabin, et al.
Published: (2024)

A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languages
by: Alam, Md Mahfuz Ibn, et al.
Published: (2024)

Unlearning Climate Misinformation in Large Language Models
by: Fore, Michael, et al.
Published: (2024)

KnowBias: Mitigating Social Bias in LLMs via Know-Bias Neuron Enhancement
by: Pan, Jinhao, et al.
Published: (2026)

CMULAB: An Open-Source Framework for Training and Deployment of Natural Language Processing Models
by: Sheikh, Zaid, et al.
Published: (2024)

Language and Speech Technology for Central Kurdish Varieties
by: Ahmadi, Sina, et al.
Published: (2024)