Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2511.21658 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910026392666112 |
|---|---|
| author | Ghaharian, Kasra Dragicevic, Simo Percy, Chris Nelson, Sarah E. Murch, W. Spencer Heirene, Robert M. Simeon-Rose, Kahlil Schrans, Tracy |
| author_facet | Ghaharian, Kasra Dragicevic, Simo Percy, Chris Nelson, Sarah E. Murch, W. Spencer Heirene, Robert M. Simeon-Rose, Kahlil Schrans, Tracy |
| contents | Artificial intelligence-based systems for player risk detection have become central to harm prevention efforts in the gambling industry. However, growing concerns around transparency and effectiveness have highlighted the absence of standardized methods for evaluating the quality and impact of these tools. This makes it impossible to gauge true progress; even as new systems are developed, their comparative effectiveness remains unknown. We argue the critical next innovation is developing a framework to measure these systems. This paper proposes a conceptual benchmarking framework to support the systematic evaluation of player risk detection systems. Benchmarking, in this context, refers to the structured and repeatable assessment of artificial intelligence models using standardized datasets, clearly defined tasks, and agreed-upon performance metrics. The goal is to enable objective, comparable, and longitudinal evaluation of player risk detection systems. We present a domain-specific framework for benchmarking that addresses the unique challenges of player risk detection in gambling and supports key stakeholders, including researchers, operators, vendors, and regulators. By enhancing transparency and improving system effectiveness, this framework aims to advance innovation and promote responsible artificial intelligence adoption in gambling harm prevention. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_21658 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The Need for Benchmarks to Advance AI-Enabled Player Risk Detection in Gambling Ghaharian, Kasra Dragicevic, Simo Percy, Chris Nelson, Sarah E. Murch, W. Spencer Heirene, Robert M. Simeon-Rose, Kahlil Schrans, Tracy Computers and Society Artificial intelligence-based systems for player risk detection have become central to harm prevention efforts in the gambling industry. However, growing concerns around transparency and effectiveness have highlighted the absence of standardized methods for evaluating the quality and impact of these tools. This makes it impossible to gauge true progress; even as new systems are developed, their comparative effectiveness remains unknown. We argue the critical next innovation is developing a framework to measure these systems. This paper proposes a conceptual benchmarking framework to support the systematic evaluation of player risk detection systems. Benchmarking, in this context, refers to the structured and repeatable assessment of artificial intelligence models using standardized datasets, clearly defined tasks, and agreed-upon performance metrics. The goal is to enable objective, comparable, and longitudinal evaluation of player risk detection systems. We present a domain-specific framework for benchmarking that addresses the unique challenges of player risk detection in gambling and supports key stakeholders, including researchers, operators, vendors, and regulators. By enhancing transparency and improving system effectiveness, this framework aims to advance innovation and promote responsible artificial intelligence adoption in gambling harm prevention. |
| title | The Need for Benchmarks to Advance AI-Enabled Player Risk Detection in Gambling |
| topic | Computers and Society |
| url | https://arxiv.org/abs/2511.21658 |