Cover Image

SEA-HELM: Southeast Asian Holistic Evaluation of Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Susanto, Yosephine, Hulagadri, Adithya Venkatadri, Montalan, Jann Railey, Ngui, Jian Gang, Yong, Xian Bin, Leong, Weiqi, Rengarajan, Hamsawardhini, Limkonchotiwat, Peerat, Mai, Yifan, Tjhi, William Chandra
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Kalahi: A handcrafted, grassroots cultural LLM evaluation suite for Filipino
by: Montalan, Jann Railey, et al.
Published: (2024)

SEA-BED: How Do Embedding Models Represent Southeast Asian Languages?
by: Ponwitayarat, Wuttikorn, et al.
Published: (2025)

BURMESE-SAN: Burmese NLP Benchmark for Evaluating Large Language Models
by: Aung, Thura, et al.
Published: (2026)

SEA-LION: Southeast Asian Languages in One Network
by: Ng, Raymond, et al.
Published: (2025)

SEA-Guard: Culturally Grounded Multilingual Safeguard for Southeast Asia
by: Tasawong, Panuthep, et al.
Published: (2026)

SEA-SafeguardBench: Evaluating AI Safety in SEA Languages and Cultures
by: Tasawong, Panuthep, et al.
Published: (2025)

Batayan: A Filipino NLP benchmark for evaluating Large Language Models
by: Montalan, Jann Railey, et al.
Published: (2025)

SEADialogues: A Multilingual Culturally Grounded Multi-turn Dialogue Dataset on Southeast Asian Languages
by: Kautsar, Muhammad Dehan Al, et al.
Published: (2025)

Space Decomposition for Sentence Embedding
by: Ponwitayarat, Wuttikorn, et al.
Published: (2024)

Seed-Free Synthetic Data Generation Framework for Instruction-Tuning LLMs: A Case Study in Thai
by: Pengpun, Parinthapat, et al.
Published: (2024)

MedHELM: Holistic Evaluation of Large Language Models for Medical Tasks
by: Bedi, Suhana, et al.
Published: (2025)

SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages
by: Lovenia, Holy, et al.
Published: (2024)

Magnetohydrodynamic Natural Convection in a Circular Dome‐Shaped Enclosure
by: K. Venkatadri
Published: (2024)

Assessing Thai Dialect Performance in LLMs with Automatic Benchmarks and Human Evaluation
by: Limkonchotiwat, Peerat, et al.
Published: (2025)

When Better Teachers Don't Make Better Students: Revisiting Knowledge Distillation for CLIP Models in VQA
by: Tuchinda, Pume, et al.
Published: (2025)

Decom-Renorm-Merge: Model Merging on the Right Space Improves Multitasking
by: Chaichana, Yuatyong, et al.
Published: (2025)

Distilling Multilingual Vision-Language Models: When Smaller Models Stay Multilingual
by: Sriratanawilai, Sukrit, et al.
Published: (2025)

Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation
by: Singh, Shivalika, et al.
Published: (2024)

Enhanced Magnetic and Dielectric Properties of YFeO3 Ceramics via Formation of Solid‐Solution with Sr2Bi4Ti5O18 and ZnSnO3 Oxides
by: Kolleti Venkatadri, et al.
Published: (2024)

ThaiCoref: Thai Coreference Resolution Dataset
by: Trakuekul, Pontakorn, et al.
Published: (2024)

Mangosteen: An Open Thai Corpus for Language Model Pretraining
by: Phatthiyaphaibun, Wannaphong, et al.
Published: (2025)

MultiLexNorm++: A Unified Benchmark and a Generative Model for Lexical Normalization for Asian Languages
by: Buaphet, Weerayut, et al.
Published: (2026)

Thai Universal Dependency Treebank
by: Sriwirote, Panyut, et al.
Published: (2024)

Southeast Asian Anthropologies
Published: (2019)

Southeast Asian Transformations
Published: (2020)

Southeast Asian Transformations
Published: (2026)

Unveiling financial inclusion dynamics: Fintech's resonance in Association of Southeast Asian Nations (ASEAN)
by: Dao Ha, et al.
Published: (2024)

HELM: Human-Preferred Exploration with Language Models
by: Liao, Shuhao, et al.
Published: (2025)

Algorithmic Feature Highlighting for Human-AI Decision-Making
by: Guo, Yifan, et al.
Published: (2026)

Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asia
by: Cahyawijaya, Samuel, et al.
Published: (2025)

Advances in Southeast Asian Studies
Published: (2022)

Southeast Asian Business Review
Published: (2025)

WangchanThaiInstruct: An instruction-following Dataset for Culture-Aware, Multitask, and Multi-domain Evaluation in Thai
by: Limkonchotiwat, Peerat, et al.
Published: (2025)

HELM: Hierarchical Encoding for mRNA Language Modeling
by: Yazdani-Jahromi, Mehdi, et al.
Published: (2024)

Can General-Purpose Large Language Models Generalize to English-Thai Machine Translation ?
by: Chiaranaipanich, Jirat, et al.
Published: (2024)

Towards Better Understanding of Program-of-Thought Reasoning in Cross-Lingual and Multilingual Environments
by: Payoungkhamdee, Patomporn, et al.
Published: (2025)

WangchanLion and WangchanX MRC Eval
by: Phatthiyaphaibun, Wannaphong, et al.
Published: (2024)

PyThaiNLP: Thai Natural Language Processing in Python
by: Phatthiyaphaibun, Wannaphong, et al.
Published: (2023)

Women in Southeast Asian Nationalist Movements
Published: (2019)

Southeast Asian Mathematics Education Journal
Published: (2022)