Imagen de Portada

To Generate or Discriminate? Methodological Considerations for Measuring Cultural Alignment in LLMs

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Pandey, Saurabh Kumar, Saha, Sougata, Choudhury, Monojit
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Meta-Cultural Competence: Climbing the Right Hill of Cultural Awareness
por: Saha, Sougata, et al.
Publicado: (2025)

Reading between the Lines: Can LLMs Identify Cross-Cultural Communication Gaps?
por: Saha, Sougata, et al.
Publicado: (2025)

User Behavior Prediction as a Generic, Robust, Scalable, and Low-Cost Evaluation Strategy for Estimating Generalization in LLMs
por: Saha, Sougata, et al.
Publicado: (2025)

Women, Infamous, and Exotic Beings: A Comparative Study of Honorific Usages in Wikipedia and LLMs for Bengali and Hindi
por: Mukherjee, Sourabrata, et al.
Publicado: (2025)

SMAB: MAB based word Sensitivity Estimation Framework and its Applications in Adversarial Text Generation
por: Pandey, Saurabh Kumar, et al.
Publicado: (2025)

Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language we Prompt them in
por: Agarwal, Utkarsh, et al.
Publicado: (2024)

[WIP] Jailbreak Paradox: The Achilles' Heel of LLMs
por: Rao, Abhinav, et al.
Publicado: (2024)

Towards Measuring and Modeling "Culture" in LLMs: A Survey
por: Adilazuarda, Muhammad Farid, et al.
Publicado: (2024)

Do Moral Judgment and Reasoning Capability of LLMs Change with Language? A Study using the Multilingual Defining Issues Test
por: Khandelwal, Aditi, et al.
Publicado: (2024)

Tricking LLMs into Disobedience: Formalizing, Analyzing, and Detecting Jailbreaks
por: Rao, Abhinav, et al.
Publicado: (2023)

Consolidating Strategies for Countering Hate Speech Using Persuasive Dialogues
por: Saha, Sougata, et al.
Publicado: (2024)

Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Prompting
por: Mukherjee, Sagnik, et al.
Publicado: (2024)

Litmus (Re)Agent: A Benchmark and Agentic System for Predictive Evaluation of Multilingual Models
por: Mittal, Avni, et al.
Publicado: (2026)

All that is English may be Hindi: Enhancing language identification through automatic ranking of likeliness of word borrowing in social media
por: Patro, Jasabanta, et al.
Publicado: (2017)

Low-Resource Counterspeech Generation for Indic Languages: The Case of Bengali and Hindi
por: Das, Mithun, et al.
Publicado: (2024)

Music for All: Representational Bias and Cross-Cultural Adaptability of Music Generation Models
por: Mehta, Atharva, et al.
Publicado: (2025)

Missing Melodies: AI Music Generation and its "Nearly" Complete Omission of the Global South
por: Mehta, Atharva, et al.
Publicado: (2024)

Steering Conversational Large Language Models for Long Emotional Support Conversations
por: Madani, Navid, et al.
Publicado: (2024)

Exploring Adapter Design Tradeoffs for Low Resource Music Generation
por: Mehta, Atharva, et al.
Publicado: (2025)

Evaluating Large Language Models for Health-related Queries with Presuppositions
por: Kaur, Navreet, et al.
Publicado: (2023)

Sacred or Synthetic? Evaluating LLM Reliability and Abstention for Religious Questions
por: Atif, Farah, et al.
Publicado: (2025)

Lost in Transcription, Found in Distribution Shift: Demystifying Hallucination in Speech Foundation Models
por: Atwany, Hanin, et al.
Publicado: (2025)

Evaluating Human-LLM Representation Alignment: A Case Study on Affective Sentence Generation for Augmentative and Alternative Communication
por: Choudhury, Shadab, et al.
Publicado: (2025)

Fairness through Difference Awareness: Measuring Desired Group Discrimination in LLMs
por: Wang, Angelina, et al.
Publicado: (2025)

Self-Alignment: Improving Alignment of Cultural Values in LLMs via In-Context Learning
por: Choenni, Rochelle, et al.
Publicado: (2024)

The Zeno's Paradox of `Low-Resource' Languages
por: Nigatu, Hellina Hailu, et al.
Publicado: (2024)

"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversations
por: Dammu, Preetam Prabhu Srikar, et al.
Publicado: (2024)

Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMs
por: Chae, Kyubyung, et al.
Publicado: (2025)

UNVEILING: What Makes Linguistics Olympiad Puzzles Tricky for LLMs?
por: Choudhary, Mukund, et al.
Publicado: (2025)

Can LLMs Express Personality Across Cultures? Introducing CulturalPersonas for Evaluating Trait Alignment
por: Dey, Priyanka, et al.
Publicado: (2025)

How Deep Is Representational Bias in LLMs? The Cases of Caste and Religion
por: Seth, Agrima, et al.
Publicado: (2025)

On Generalization across Measurement Systems: LLMs Entail More Test-Time Compute for Underrepresented Cultures
por: Bui, Minh Duc, et al.
Publicado: (2025)

CURE: Cultural Understanding and Reasoning Evaluation - A Framework for "Thick" Culture Alignment Evaluation in LLMs
por: Vo, Truong, et al.
Publicado: (2025)

Steering LLMs for Culturally Localized Generation
por: Khanuja, Simran, et al.
Publicado: (2026)

Lessons Without Borders? Evaluating Cultural Alignment of LLMs Using Multilingual Story Moral Generation
por: Wu, Sophie, et al.
Publicado: (2026)

The Greatest Good Benchmark: Measuring LLMs' Alignment with Utilitarian Moral Dilemmas
por: Marraffini, Giovanni Franco Gabriel, et al.
Publicado: (2025)

Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs
por: Kabir, Mohsinul, et al.
Publicado: (2025)

On Zero-Shot Counterspeech Generation by LLMs
por: Saha, Punyajoy, et al.
Publicado: (2024)

Fluent but Foreign: Even Regional LLMs Lack Cultural Alignment
por: Agarwal, Dhruv, et al.
Publicado: (2025)

Enabling Discriminative Reasoning in LLMs for Legal Judgment Prediction
por: Deng, Chenlong, et al.
Publicado: (2024)