pix2pockets: Shot Suggestions in 8-Ball Pool from a Single Image in the Wild

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Schiøtt, Jonas Myhre, Petersen, Viktor Sebastian, Papadopoulos, Dim P.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913811925041152
author Schiøtt, Jonas Myhre
Petersen, Viktor Sebastian
Papadopoulos, Dim P.
author_facet Schiøtt, Jonas Myhre
Petersen, Viktor Sebastian
Papadopoulos, Dim P.
contents Computer vision models have seen increased usage in sports, and reinforcement learning (RL) is famous for beating humans in strategic games such as Chess and Go. In this paper, we are interested in building upon these advances and examining the game of classic 8-ball pool. We introduce pix2pockets, a foundation for an RL-assisted pool coach. Given a single image of a pool table, we first aim to detect the table and the balls and then propose the optimal shot suggestion. For the first task, we build a dataset with 195 diverse images where we manually annotate all balls and table dots, leading to 5748 object segmentation masks. For the second task, we build a standardized RL environment that allows easy development and benchmarking of any RL algorithm. Our object detection model yields an AP50 of 91.2 while our ball location pipeline obtains an error of only 0.4 cm. Furthermore, we compare standard RL algorithms to set a baseline for the shot suggestion task and we show that all of them fail to pocket all balls without making a foul move. We also present a simple baseline that achieves a per-shot success rate of 94.7% and clears a full game in a single turn 30% of the time.
format Preprint
id arxiv_https___arxiv_org_abs_2504_12045
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle pix2pockets: Shot Suggestions in 8-Ball Pool from a Single Image in the Wild
Schiøtt, Jonas Myhre
Petersen, Viktor Sebastian
Papadopoulos, Dim P.
Computer Vision and Pattern Recognition
Machine Learning
I.2.1; I.4.6
Computer vision models have seen increased usage in sports, and reinforcement learning (RL) is famous for beating humans in strategic games such as Chess and Go. In this paper, we are interested in building upon these advances and examining the game of classic 8-ball pool. We introduce pix2pockets, a foundation for an RL-assisted pool coach. Given a single image of a pool table, we first aim to detect the table and the balls and then propose the optimal shot suggestion. For the first task, we build a dataset with 195 diverse images where we manually annotate all balls and table dots, leading to 5748 object segmentation masks. For the second task, we build a standardized RL environment that allows easy development and benchmarking of any RL algorithm. Our object detection model yields an AP50 of 91.2 while our ball location pipeline obtains an error of only 0.4 cm. Furthermore, we compare standard RL algorithms to set a baseline for the shot suggestion task and we show that all of them fail to pocket all balls without making a foul move. We also present a simple baseline that achieves a per-shot success rate of 94.7% and clears a full game in a single turn 30% of the time.
title pix2pockets: Shot Suggestions in 8-Ball Pool from a Single Image in the Wild
topic Computer Vision and Pattern Recognition
Machine Learning
I.2.1; I.4.6
url https://arxiv.org/abs/2504.12045