Cover Image

CulturalFrames: Assessing Cultural Expectation Alignment in Text-to-Image Models and Evaluation Metrics

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nayak, Shravan, Bhatia, Mehar, Zhang, Xiaofeng, Rieser, Verena, Hendricks, Lisa Anne, van Steenkiste, Sjoerd, Goyal, Yash, Stańczak, Karolina, Agrawal, Aishwarya
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Benchmarking Vision Language Models for Cultural Understanding
by: Nayak, Shravan, et al.
Published: (2024)

Value Drifts: Tracing Value Alignment During LLM Post-Training
by: Bhatia, Mehar, et al.
Published: (2025)

A Multilingual Perspective on Probing Gender Bias
by: Stańczak, Karolina
Published: (2024)

Assessing and Learning Alignment of Unimodal Vision and Language Models
by: Zhang, Le, et al.
Published: (2024)

An Examination of the Robustness of Reference-Free Image Captioning Evaluation Metrics
by: Ahmadi, Saba, et al.
Published: (2023)

Is It Bad to Work All the Time? Cross-Cultural Evaluation of Social Norm Biases in GPT-4
by: Liu, Zhuozhuo Joy, et al.
Published: (2025)

Discovering Failure Modes in Vision-Language Models using RL
by: Jain, Kanishk, et al.
Published: (2026)

Societal Alignment Frameworks Can Improve LLM Alignment
by: Stańczak, Karolina, et al.
Published: (2025)

How Does Code Pretraining Affect Language Model Task Performance?
by: Petty, Jackson, et al.
Published: (2024)

Quantifying Gender Biases Towards Politicians on Reddit
by: Marjanovic, Sara, et al.
Published: (2021)

CulturalBench: A Robust, Diverse, and Challenging Cultural Benchmark by Human-AI CulturalTeaming
by: Chiu, Yu Ying, et al.
Published: (2024)

Cultural Authenticity: Comparing LLM Cultural Representations to Native Human Expectations
by: van Liemt, Erin MacMurray, et al.
Published: (2026)

CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledge
by: Chiu, Yu Ying, et al.
Published: (2024)

Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMs
by: Chae, Kyubyung, et al.
Published: (2025)

Rethinking Cross-lingual Alignment: Balancing Transfer and Cultural Erasure in Multilingual LLMs
by: Han, HyoJung, et al.
Published: (2025)

From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models
by: Bhatia, Mehar, et al.
Published: (2024)

LIVS: A Pluralistic Alignment Dataset for Inclusive Public Spaces
by: Mushkani, Rashid, et al.
Published: (2025)

LLMs and Cultural Values: the Impact of Prompt Language and Explicit Cultural Framing
by: Bulté, Bram, et al.
Published: (2025)

The Impact of Depth on Compositional Generalization in Transformer Language Models
by: Petty, Jackson, et al.
Published: (2023)

Social Bias Probing: Fairness Benchmarking for Language Models
by: Manerba, Marta Marchiori, et al.
Published: (2023)

Assessing the Sensitivity and Alignment of FOL Closeness Metrics
by: Thatikonda, Ramya Keerthy, et al.
Published: (2025)

Cultural Bias and Cultural Alignment of Large Language Models
by: Tao, Yan, et al.
Published: (2023)

Investigating Cultural Alignment of Large Language Models
by: AlKhamissi, Badr, et al.
Published: (2024)

Can Automatic Metrics Assess High-Quality Translations?
by: Agrawal, Sweta, et al.
Published: (2024)

Cultural Palette: Pluralising Culture Alignment via Multi-agent Palette
by: Yuan, Jiahao, et al.
Published: (2024)

Assessing effect sizes, variability, and power in the on-line study of language production
by: Audrey, Bürki, et al.
Published: (2024)

Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensions
by: Masoud, Reem I., et al.
Published: (2023)

Decompose and Compare Consistency: Measuring VLMs' Answer Reliability via Task-Decomposition Consistency Comparison
by: Yang, Qian, et al.
Published: (2024)

Investigating Prompting Techniques for Zero- and Few-Shot Visual Question Answering
by: Awal, Rabiul, et al.
Published: (2023)

Bayesian Teaching Enables Probabilistic Reasoning in Large Language Models
by: Qiu, Linlu, et al.
Published: (2025)

Culture Clash: When Deceptive Design Meets Diverse Player Expectations
by: Hadan, Hilda, et al.
Published: (2025)

The Causal Influence of Grammatical Gender on Distributional Semantics
by: Stańczak, Karolina, et al.
Published: (2023)

CURE: Cultural Understanding and Reasoning Evaluation - A Framework for "Thick" Culture Alignment Evaluation in LLMs
by: Vo, Truong, et al.
Published: (2025)

Rethinking AI Cultural Alignment
by: Bravansky, Michal, et al.
Published: (2025)

Cultural Perspectives and Expectations for Generative AI: A Global Survey Approach
by: van Liemt, Erin, et al.
Published: (2026)

Conceptual Cultural Index: A Metric for Cultural Specificity via Relative Generality
by: Ohashi, Takumi, et al.
Published: (2026)

DORSal: Diffusion for Object-centric Representations of Scenes et al
by: Jabri, Allan, et al.
Published: (2023)

Whispers of Many Shores: Cultural Alignment through Collaborative Cultural Expertise
by: Feng, Shuai, et al.
Published: (2025)

A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models
by: Eisape, Tiwalayo, et al.
Published: (2023)

How to Spin an Object: First, Get the Shape Right
by: Kabra, Rishabh, et al.
Published: (2024)