Complete Chess Games Enable LLM Become A Chess Master

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhang, Yinqi, Han, Xintian, Li, Haolong, Chen, Kedi, Lin, Shaohui
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912210225201152
author Zhang, Yinqi
Han, Xintian
Li, Haolong
Chen, Kedi
Lin, Shaohui
author_facet Zhang, Yinqi
Han, Xintian
Li, Haolong
Chen, Kedi
Lin, Shaohui
contents Large language models (LLM) have shown remarkable abilities in text generation, question answering, language translation, reasoning and many other tasks. It continues to advance rapidly and is becoming increasingly influential in various fields, from technology and business to education and entertainment. Despite LLM's success in multiple areas, its ability to play abstract games, such as chess, is underexplored. Chess-playing requires the language models to output legal and reasonable moves from textual inputs. Here, we propose the Large language model ChessLLM to play full chess games. We transform the game into a textual format with the best move represented in the Forsyth-Edwards Notation. We show that by simply supervised fine-tuning, our model has achieved a professional-level Elo rating of 1788 in matches against the standard Elo-rated Stockfish when permitted to sample 10 times. We further show that data quality is important. Long-round data supervision enjoys a 350 Elo rating improvement over short-round data.
format Preprint
id arxiv_https___arxiv_org_abs_2501_17186
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Complete Chess Games Enable LLM Become A Chess Master
Zhang, Yinqi
Han, Xintian
Li, Haolong
Chen, Kedi
Lin, Shaohui
Artificial Intelligence
Computation and Language
Machine Learning
Large language models (LLM) have shown remarkable abilities in text generation, question answering, language translation, reasoning and many other tasks. It continues to advance rapidly and is becoming increasingly influential in various fields, from technology and business to education and entertainment. Despite LLM's success in multiple areas, its ability to play abstract games, such as chess, is underexplored. Chess-playing requires the language models to output legal and reasonable moves from textual inputs. Here, we propose the Large language model ChessLLM to play full chess games. We transform the game into a textual format with the best move represented in the Forsyth-Edwards Notation. We show that by simply supervised fine-tuning, our model has achieved a professional-level Elo rating of 1788 in matches against the standard Elo-rated Stockfish when permitted to sample 10 times. We further show that data quality is important. Long-round data supervision enjoys a 350 Elo rating improvement over short-round data.
title Complete Chess Games Enable LLM Become A Chess Master
topic Artificial Intelligence
Computation and Language
Machine Learning
url https://arxiv.org/abs/2501.17186