OpenThaiGPT 1.5: A Thai-Centric Open Source Large Language Model

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yuenyong, Sumeth, Viriyayudhakorn, Kobkrit, Piyatumrong, Apivadee, Jaroenkantasima, Jillaphat
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912245079867392
author Yuenyong, Sumeth
Viriyayudhakorn, Kobkrit
Piyatumrong, Apivadee
Jaroenkantasima, Jillaphat
author_facet Yuenyong, Sumeth
Viriyayudhakorn, Kobkrit
Piyatumrong, Apivadee
Jaroenkantasima, Jillaphat
contents OpenThaiGPT 1.5 is an advanced Thai language chat model based on Qwen v2.5, finetuned on over 2,000,000 Thai instruction pairs. This report provides an engineering perspective on the model's development, capabilities, and performance. We discuss the model's architecture, training process, and key features, including multi-turn conversation support, Retrieval Augmented Generation (RAG) compatibility, and tool-calling functionality. Benchmark results demonstrate OpenThaiGPT 1.5's state-of-the-art performance on various Thai language tasks, outperforming other open-source Thai language models. We also address practical considerations such as GPU memory requirements and deployment strategies.
format Preprint
id arxiv_https___arxiv_org_abs_2411_07238
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle OpenThaiGPT 1.5: A Thai-Centric Open Source Large Language Model
Yuenyong, Sumeth
Viriyayudhakorn, Kobkrit
Piyatumrong, Apivadee
Jaroenkantasima, Jillaphat
Computation and Language
OpenThaiGPT 1.5 is an advanced Thai language chat model based on Qwen v2.5, finetuned on over 2,000,000 Thai instruction pairs. This report provides an engineering perspective on the model's development, capabilities, and performance. We discuss the model's architecture, training process, and key features, including multi-turn conversation support, Retrieval Augmented Generation (RAG) compatibility, and tool-calling functionality. Benchmark results demonstrate OpenThaiGPT 1.5's state-of-the-art performance on various Thai language tasks, outperforming other open-source Thai language models. We also address practical considerations such as GPU memory requirements and deployment strategies.
title OpenThaiGPT 1.5: A Thai-Centric Open Source Large Language Model
topic Computation and Language
url https://arxiv.org/abs/2411.07238