CueTip: An Interactive and Explainable Physics-aware Pool Assistant

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Memery, Sean, Denamganai, Kevin, Zhang, Jiaxin, Tu, Zehai, Guo, Yiwen, Subr, Kartic
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909540555948032
author Memery, Sean
Denamganai, Kevin
Zhang, Jiaxin
Tu, Zehai
Guo, Yiwen
Subr, Kartic
author_facet Memery, Sean
Denamganai, Kevin
Zhang, Jiaxin
Tu, Zehai
Guo, Yiwen
Subr, Kartic
contents We present an interactive and explainable automated coaching assistant called CueTip for a variant of pool/billiards. CueTip's novelty lies in its combination of three features: a natural-language interface, an ability to perform contextual, physics-aware reasoning, and that its explanations are rooted in a set of predetermined guidelines developed by domain experts. We instrument a physics simulator so that it generates event traces in natural language alongside traditional state traces. Event traces lend themselves to interpretation by language models, which serve as the interface to our assistant. We design and train a neural adaptor that decouples tactical choices made by CueTip from its interactivity and explainability allowing it to be reconfigured to mimic any pool playing agent. Our experiments show that CueTip enables contextual query-based assistance and explanations while maintaining the strength of the agent in terms of win rate (improving it in some situations). The explanations generated by CueTip are physically-aware and grounded in the expert rules and are therefore more reliable.
format Preprint
id arxiv_https___arxiv_org_abs_2501_18291
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CueTip: An Interactive and Explainable Physics-aware Pool Assistant
Memery, Sean
Denamganai, Kevin
Zhang, Jiaxin
Tu, Zehai
Guo, Yiwen
Subr, Kartic
Artificial Intelligence
Human-Computer Interaction
I.2.1; I.2.7
We present an interactive and explainable automated coaching assistant called CueTip for a variant of pool/billiards. CueTip's novelty lies in its combination of three features: a natural-language interface, an ability to perform contextual, physics-aware reasoning, and that its explanations are rooted in a set of predetermined guidelines developed by domain experts. We instrument a physics simulator so that it generates event traces in natural language alongside traditional state traces. Event traces lend themselves to interpretation by language models, which serve as the interface to our assistant. We design and train a neural adaptor that decouples tactical choices made by CueTip from its interactivity and explainability allowing it to be reconfigured to mimic any pool playing agent. Our experiments show that CueTip enables contextual query-based assistance and explanations while maintaining the strength of the agent in terms of win rate (improving it in some situations). The explanations generated by CueTip are physically-aware and grounded in the expert rules and are therefore more reliable.
title CueTip: An Interactive and Explainable Physics-aware Pool Assistant
topic Artificial Intelligence
Human-Computer Interaction
I.2.1; I.2.7
url https://arxiv.org/abs/2501.18291