The Need for Benchmarks to Advance AI-Enabled Player Risk Detection in Gambling

Gambling
Authors

Kasra Ghaharian

Simo Dragicevic

Chris Percy

Sarah Nelson

Spencer Murch

Rob Heirene

Kahlil Simeon-Rose

Tracy Schrans

Published

February 18, 2026

Abstract

Artificial intelligence-based systems for player risk detection have become central to harm prevention efforts in the gambling industry. However, growing concerns around transparency and effectiveness have highlighted the absence of standardized methods for evaluating the quality and impact of these tools. This makes it impossible to gauge true progress; even as new systems are developed, their comparative effectiveness remains unknown. We argue the critical next innovation is developing a framework to measure these systems. This paper proposes a conceptual benchmarking framework to support the systematic evaluation of player risk detection systems. Benchmarking, in this context, refers to the structured and repeatable assessment of artificial intelligence models using standardized datasets, clearly defined tasks, and agreed-upon performance metrics. The goal is to enable objective, comparable, and longitudinal evaluation of player risk detection systems. We present a domain-specific framework for benchmarking that addresses the unique challenges of player risk detection in gambling and supports key stakeholders, including researchers, operators, vendors, and regulators. By enhancing transparency and improving system effectiveness, this framework aims to advance innovation and promote responsible artificial intelligence adoption in gambling harm prevention.

Full text

APA citation

Transparency

Pre-registered Open materials Open code Open data
NA NA NA NA