Imagen de Portada

Assessing Thai Dialect Performance in LLMs with Automatic Benchmarks and Human Evaluation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Limkonchotiwat, Peerat, Masuk, Kanruethai, Nonesung, Surapon, Mai-On, Chalermpun, Nutanong, Sarana, Ponwitayarat, Wuttikorn, Manakul, Potsawee
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Space Decomposition for Sentence Embedding
por: Ponwitayarat, Wuttikorn, et al.
Publicado: (2024)

WangchanThaiInstruct: An instruction-following Dataset for Culture-Aware, Multitask, and Multi-domain Evaluation in Thai
por: Limkonchotiwat, Peerat, et al.
Publicado: (2025)

WangchanLion and WangchanX MRC Eval
por: Phatthiyaphaibun, Wannaphong, et al.
Publicado: (2024)

Prior Prompt Engineering for Reinforcement Fine-Tuning
por: Taveekitworachai, Pittawat, et al.
Publicado: (2025)

Towards Better Understanding of Program-of-Thought Reasoning in Cross-Lingual and Multilingual Environments
por: Payoungkhamdee, Patomporn, et al.
Publicado: (2025)

Mangosteen: An Open Thai Corpus for Language Model Pretraining
por: Phatthiyaphaibun, Wannaphong, et al.
Publicado: (2025)

When Better Teachers Don't Make Better Students: Revisiting Knowledge Distillation for CLIP Models in VQA
por: Tuchinda, Pume, et al.
Publicado: (2025)

SEA-BED: How Do Embedding Models Represent Southeast Asian Languages?
por: Ponwitayarat, Wuttikorn, et al.
Publicado: (2025)

Distilling Multilingual Vision-Language Models: When Smaller Models Stay Multilingual
por: Sriratanawilai, Sukrit, et al.
Publicado: (2025)

Typhoon 2: A Family of Open Text and Multimodal Thai Large Language Models
por: Pipatanakul, Kunat, et al.
Publicado: (2024)

Typhoon OCR: Open Vision-Language Model For Thai Document Extraction
por: Nonesung, Surapon, et al.
Publicado: (2026)

ThaiOCRBench: A Task-Diverse Benchmark for Vision-Language Understanding in Thai
por: Nonesung, Surapon, et al.
Publicado: (2025)

Seed-Free Synthetic Data Generation Framework for Instruction-Tuning LLMs: A Case Study in Thai
por: Pengpun, Parinthapat, et al.
Publicado: (2024)

Typhoon T1: An Open Thai Reasoning Model
por: Taveekitworachai, Pittawat, et al.
Publicado: (2025)

Typhoon ASR Real-time: FastConformer-Transducer for Thai Automatic Speech Recognition
por: Sirichotedumrong, Warit, et al.
Publicado: (2026)

A Two-Phase Stability Study of LLM Judges and Bar Council Examiners on Thai Bar-Exam Free-Form Essays
por: Akarajaradwong, Pawitsapak, et al.
Publicado: (2026)

Addressing Topic Leakage in Cross-Topic Evaluation for Authorship Verification
por: Sawatphol, Jitkapat, et al.
Publicado: (2024)

MultiLexNorm++: A Unified Benchmark and a Generative Model for Lexical Normalization for Asian Languages
por: Buaphet, Weerayut, et al.
Publicado: (2026)

BURMESE-SAN: Burmese NLP Benchmark for Evaluating Large Language Models
por: Aung, Thura, et al.
Publicado: (2026)

Can Group Relative Policy Optimization Improve Thai Legal Reasoning and Question Answering?
por: Akarajaradwong, Pawitsapak, et al.
Publicado: (2025)

LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models
por: Liusie, Adian, et al.
Publicado: (2023)

Adapting Language-Specific LLMs to a Reasoning Model in One Day via Model Merging -- An Open Recipe
por: Pipatanakul, Kunat, et al.
Publicado: (2025)

NitiBench: A Comprehensive Study of LLM Framework Capabilities for Thai Legal Question Answering
por: Akarajaradwong, Pawitsapak, et al.
Publicado: (2025)

PyThaiNLP: Thai Natural Language Processing in Python
por: Phatthiyaphaibun, Wannaphong, et al.
Publicado: (2023)

SEA-SafeguardBench: Evaluating AI Safety in SEA Languages and Cultures
por: Tasawong, Panuthep, et al.
Publicado: (2025)

SkillAggregation: Reference-free LLM-Dependent Aggregation
por: Sun, Guangzhi, et al.
Publicado: (2024)

Can General-Purpose Large Language Models Generalize to English-Thai Machine Translation ?
por: Chiaranaipanich, Jirat, et al.
Publicado: (2024)

Exploring Cross-Client Memorization of Training Data in Large Language Models for Federated Learning
por: Udsa, Tinnakit, et al.
Publicado: (2025)

FinCoT: Grounding Chain-of-Thought in Expert Financial Reasoning
por: Nitarach, Natapong, et al.
Publicado: (2025)

Extending Audio Context for Long-Form Understanding in Large Audio-Language Models
por: Chaichana, Yuatyong, et al.
Publicado: (2025)

Enhancing Low-Resource Language and Instruction Following Capabilities of Audio Language Models
por: Manakul, Potsawee, et al.
Publicado: (2024)

SEA-Guard: Culturally Grounded Multilingual Safeguard for Southeast Asia
por: Tasawong, Panuthep, et al.
Publicado: (2026)

CrossCheckGPT: Universal Hallucination Ranking for Multimodal Foundation Models
por: Sun, Guangzhi, et al.
Publicado: (2024)

Mind the Gap! Static and Interactive Evaluations of Large Audio Models
por: Li, Minzhi, et al.
Publicado: (2025)

On Creating an English-Thai Code-switched Machine Translation in Medical Domain
por: Pengpun, Parinthapat, et al.
Publicado: (2024)

Scaling Open Discrete Audio Foundation Models with Interleaved Semantic, Acoustic, and Text Tokens
por: Manakul, Potsawee, et al.
Publicado: (2026)

Exploiting Dialect Identification in Automatic Dialectal Text Normalization
por: Alhafni, Bashar, et al.
Publicado: (2024)

Analyzing Dialectical Biases in LLMs for Knowledge and Reasoning Benchmarks
por: Pan, Eileen, et al.
Publicado: (2025)

SEA-HELM: Southeast Asian Holistic Evaluation of Language Models
por: Susanto, Yosephine, et al.
Publicado: (2025)

AudioJudge: Understanding What Works in Large Audio Model Based Speech Evaluation
por: Manakul, Potsawee, et al.
Publicado: (2025)