Saved in:
Bibliographic Details
Main Author: Guerra, Esteban Aldana
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.16620
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Monte Carlo Tree Search (MCTS) is a powerful algorithm for solving complex decision-making problems. This paper presents an optimized MCTS implementation applied to the FrozenLake environment, a classic reinforcement learning task characterized by stochastic transitions. The optimization leverages cumulative reward and visit count tables along with the Upper Confidence Bound for Trees (UCT) formula, resulting in efficient learning in a slippery grid world. We benchmark our implementation against other decision-making algorithms, including MCTS with Policy and Q-Learning, and perform a detailed comparison of their performance. The results demonstrate that our optimized approach effectively maximizes rewards and success rates while minimizing convergence time, outperforming baseline methods, especially in environments with inherent randomness.