Analysis of Bluffing by DQN and CFR in Leduc Hold'em Poker

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zaciragic, Tarik, Plaat, Aske, Batenburg, K. Joost
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908519085637632
author Zaciragic, Tarik
Plaat, Aske
Batenburg, K. Joost
author_facet Zaciragic, Tarik
Plaat, Aske
Batenburg, K. Joost
contents In the game of poker, being unpredictable, or bluffing, is an essential skill. When humans play poker, they bluff. However, most works on computer-poker focus on performance metrics such as win rates, while bluffing is overlooked. In this paper we study whether two popular algorithms, DQN (based on reinforcement learning) and CFR (based on game theory), exhibit bluffing behavior in Leduc Hold'em, a simplified version of poker. We designed an experiment where we let the DQN and CFR agent play against each other while we log their actions. We find that both DQN and CFR exhibit bluffing behavior, but they do so in different ways. Although both attempt to perform bluffs at different rates, the percentage of successful bluffs (where the opponent folds) is roughly the same. This suggests that bluffing is an essential aspect of the game, not of the algorithm. Future work should look at different bluffing styles and at the full game of poker. Code at https://github.com/TarikZ03/Bluffing-by-DQN-and-CFR-in-Leduc-Hold-em-Poker-Codebase.
format Preprint
id arxiv_https___arxiv_org_abs_2509_04125
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Analysis of Bluffing by DQN and CFR in Leduc Hold'em Poker
Zaciragic, Tarik
Plaat, Aske
Batenburg, K. Joost
Artificial Intelligence
In the game of poker, being unpredictable, or bluffing, is an essential skill. When humans play poker, they bluff. However, most works on computer-poker focus on performance metrics such as win rates, while bluffing is overlooked. In this paper we study whether two popular algorithms, DQN (based on reinforcement learning) and CFR (based on game theory), exhibit bluffing behavior in Leduc Hold'em, a simplified version of poker. We designed an experiment where we let the DQN and CFR agent play against each other while we log their actions. We find that both DQN and CFR exhibit bluffing behavior, but they do so in different ways. Although both attempt to perform bluffs at different rates, the percentage of successful bluffs (where the opponent folds) is roughly the same. This suggests that bluffing is an essential aspect of the game, not of the algorithm. Future work should look at different bluffing styles and at the full game of poker. Code at https://github.com/TarikZ03/Bluffing-by-DQN-and-CFR-in-Leduc-Hold-em-Poker-Codebase.
title Analysis of Bluffing by DQN and CFR in Leduc Hold'em Poker
topic Artificial Intelligence
url https://arxiv.org/abs/2509.04125