Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs
Fuente:
arXiv
Guardado en:
| Autores principales: | Rystrøm, Jonathan, Kirk, Hannah Rose, Hale, Scott |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
CulturALL: Benchmarking Multilingual and Multicultural Competence of LLMs on Grounded Tasks
por: Lin, Peiqin, et al.
Publicado: (2026)
por: Lin, Peiqin, et al.
Publicado: (2026)
Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs
por: Kabir, Mohsinul, et al.
Publicado: (2025)
por: Kabir, Mohsinul, et al.
Publicado: (2025)
StereoTales: A Multilingual Framework for Open-Ended Stereotype Discovery in LLMs
por: Jeune, Pierre Le, et al.
Publicado: (2026)
por: Jeune, Pierre Le, et al.
Publicado: (2026)
Culturally Adaptive Explainable LLM Assessment for Multilingual Information Disorder: A Human-in-the-Loop Approach
por: Jouneghani, Maziar Kianimoghadam
Publicado: (2026)
por: Jouneghani, Maziar Kianimoghadam
Publicado: (2026)
Towards Safe Multilingual Frontier AI
por: Kanepajs, Artūrs, et al.
Publicado: (2024)
por: Kanepajs, Artūrs, et al.
Publicado: (2024)
Lessons Without Borders? Evaluating Cultural Alignment of LLMs Using Multilingual Story Moral Generation
por: Wu, Sophie, et al.
Publicado: (2026)
por: Wu, Sophie, et al.
Publicado: (2026)
Fluent but Foreign: Even Regional LLMs Lack Cultural Alignment
por: Agarwal, Dhruv, et al.
Publicado: (2025)
por: Agarwal, Dhruv, et al.
Publicado: (2025)
Evaluating the Capabilities of LLMs for Supporting Anticipatory Impact Assessment
por: Allaham, Mowafak, et al.
Publicado: (2024)
por: Allaham, Mowafak, et al.
Publicado: (2024)
How Does Alignment Enhance LLMs' Multilingual Capabilities? A Language Neurons Perspective
por: Zhang, Shimao, et al.
Publicado: (2025)
por: Zhang, Shimao, et al.
Publicado: (2025)
Grounding Text Embeddings in Stakeholder Associations
por: Rystrøm, Jonathan, et al.
Publicado: (2026)
por: Rystrøm, Jonathan, et al.
Publicado: (2026)
Rethinking Cross-lingual Alignment: Balancing Transfer and Cultural Erasure in Multilingual LLMs
por: Han, HyoJung, et al.
Publicado: (2025)
por: Han, HyoJung, et al.
Publicado: (2025)
Efficient Multilingual Name Type Classification Using Convolutional Networks
por: Lauc, Davor
Publicado: (2026)
por: Lauc, Davor
Publicado: (2026)
Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and English
por: Dawson, Fiifi, et al.
Publicado: (2024)
por: Dawson, Fiifi, et al.
Publicado: (2024)
Beyond Translation: LLM-Based Data Generation for Multilingual Fact-Checking
por: Chung, Yi-Ling, et al.
Publicado: (2025)
por: Chung, Yi-Ling, et al.
Publicado: (2025)
MMA-ASIA: A Multilingual and Multimodal Alignment Framework for Culturally-Grounded Evaluation
por: Zheng, Weihua, et al.
Publicado: (2025)
por: Zheng, Weihua, et al.
Publicado: (2025)
EMCEE: Improving Multilingual Capability of LLMs via Bridging Knowledge and Reasoning with Extracted Synthetic Multilingual Context
por: Koo, Hamin, et al.
Publicado: (2025)
por: Koo, Hamin, et al.
Publicado: (2025)
Multilingual LLMs Are Not Multilingual Thinkers: Evidence from Hindi Analogy Evaluation
por: Gupta, Ashray, et al.
Publicado: (2025)
por: Gupta, Ashray, et al.
Publicado: (2025)
Authorship Attribution in Multilingual Machine-Generated Texts
por: La Cava, Lucio, et al.
Publicado: (2025)
por: La Cava, Lucio, et al.
Publicado: (2025)
Oversight Structures for Agentic AI in Public-Sector Organizations
por: Schmitz, Chris, et al.
Publicado: (2025)
por: Schmitz, Chris, et al.
Publicado: (2025)
MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment
por: Kargaran, Amir Hossein, et al.
Publicado: (2024)
por: Kargaran, Amir Hossein, et al.
Publicado: (2024)
Decoding Multilingual Moral Preferences: Unveiling LLM's Biases Through the Moral Machine Experiment
por: Vida, Karina, et al.
Publicado: (2024)
por: Vida, Karina, et al.
Publicado: (2024)
Assessing the Performance of Human-Capable LLMs -- Are LLMs Coming for Your Job?
por: Mavi, John, et al.
Publicado: (2024)
por: Mavi, John, et al.
Publicado: (2024)
Evaluation of Multilingual LLMs Personalized Text Generation Capabilities Targeting Groups and Social-Media Platforms
por: Macko, Dominik
Publicado: (2026)
por: Macko, Dominik
Publicado: (2026)
Bridging Language Gaps: Advances in Cross-Lingual Information Retrieval with Multilingual LLMs
por: Goworek, Roksana, et al.
Publicado: (2025)
por: Goworek, Roksana, et al.
Publicado: (2025)
XCR-Bench: A Multi-Task Benchmark for Evaluating Cultural Reasoning in LLMs
por: Kabir, Mohsinul, et al.
Publicado: (2026)
por: Kabir, Mohsinul, et al.
Publicado: (2026)
Evaluating Multilingual and Code-Switched Alignment in LLMs via Synthetic Natural Language Inference
por: Abdaljalil, Samir, et al.
Publicado: (2025)
por: Abdaljalil, Samir, et al.
Publicado: (2025)
MateInfoUB: A Real-World Benchmark for Testing LLMs in Competitive, Multilingual, and Multimodal Educational Tasks
por: Marius, Dumitran Adrian, et al.
Publicado: (2025)
por: Marius, Dumitran Adrian, et al.
Publicado: (2025)
Why are all LLMs Obsessed with Japanese Culture? On the Hidden Cultural and Regional Biases of LLMs
por: de Landa, Joseba Fernandez, et al.
Publicado: (2026)
por: de Landa, Joseba Fernandez, et al.
Publicado: (2026)
A Multilingual Similarity Dataset for News Article Frame
por: Chen, Xi, et al.
Publicado: (2024)
por: Chen, Xi, et al.
Publicado: (2024)
Let's Play Across Cultures: A Large Multilingual, Multicultural Benchmark for Assessing Language Models' Understanding of Sports
por: Singh, Punit Kumar, et al.
Publicado: (2025)
por: Singh, Punit Kumar, et al.
Publicado: (2025)
Are LLMs Truly Multilingual? Exploring Zero-Shot Multilingual Capability of LLMs for Information Retrieval: An Italian Healthcare Use Case
por: Kembu, Vignesh Kumar, et al.
Publicado: (2025)
por: Kembu, Vignesh Kumar, et al.
Publicado: (2025)
Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQ
por: Holtermann, Carolin, et al.
Publicado: (2024)
por: Holtermann, Carolin, et al.
Publicado: (2024)
Bridging the Language Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs
por: Kumar, Somnath, et al.
Publicado: (2023)
por: Kumar, Somnath, et al.
Publicado: (2023)
Exposing Assumptions in AI Benchmarks through Cognitive Modelling
por: Rystrøm, Jonathan H., et al.
Publicado: (2024)
por: Rystrøm, Jonathan H., et al.
Publicado: (2024)
Towards Measuring and Modeling "Culture" in LLMs: A Survey
por: Adilazuarda, Muhammad Farid, et al.
Publicado: (2024)
por: Adilazuarda, Muhammad Farid, et al.
Publicado: (2024)
Are LLMs (Really) Ideological? An IRT-based Analysis and Alignment Tool for Perceived Socio-Economic Bias in LLMs
por: Wachter, Jasmin, et al.
Publicado: (2025)
por: Wachter, Jasmin, et al.
Publicado: (2025)
Indian-BhED: A Dataset for Measuring India-Centric Biases in Large Language Models
por: Khandelwal, Khyati, et al.
Publicado: (2023)
por: Khandelwal, Khyati, et al.
Publicado: (2023)
Training-Free Cultural Alignment of Large Language Models via Persona Disagreement
por: Kiet, Huynh Trung, et al.
Publicado: (2026)
por: Kiet, Huynh Trung, et al.
Publicado: (2026)
Evidence of a log scaling law for political persuasion with large language models
por: Hackenburg, Kobi, et al.
Publicado: (2024)
por: Hackenburg, Kobi, et al.
Publicado: (2024)
SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
por: Wang, Bin, et al.
Publicado: (2023)
por: Wang, Bin, et al.
Publicado: (2023)
Ejemplares similares
-
CulturALL: Benchmarking Multilingual and Multicultural Competence of LLMs on Grounded Tasks
por: Lin, Peiqin, et al.
Publicado: (2026) -
Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs
por: Kabir, Mohsinul, et al.
Publicado: (2025) -
StereoTales: A Multilingual Framework for Open-Ended Stereotype Discovery in LLMs
por: Jeune, Pierre Le, et al.
Publicado: (2026) -
Culturally Adaptive Explainable LLM Assessment for Multilingual Information Disorder: A Human-in-the-Loop Approach
por: Jouneghani, Maziar Kianimoghadam
Publicado: (2026) -
Towards Safe Multilingual Frontier AI
por: Kanepajs, Artūrs, et al.
Publicado: (2024)