Use of online crowdsourcing platforms for gambling research

Abstract

Crowdsourcing platforms like Amazon’s Mechnical Turk and Crowdflower have been touted to be a cost-effective way to collect large amounts of behavioural data. Across four large-n studies, gambling-related behaviours, tendencies and traits among participants in these labour markets were examined. In Studies 1 and 2, both conducted on Crowdflower, problem gamblers (as measured by the benchmark Problem Gambling Severity Index) comprised 24.5% and 21.9% of participants, respectively. In Study 3, conducted on Mechanical Turk, problem gamblers comprised 9.0% of participants. In Study 4, a two-wave longitudinal study conducted on Crowdflower, problem gamblers comprised 13.5% of participants in wave one and 14.8% of participants in wave two. In Studies 2 and 3, strong convergent associations were demonstrated across various measures of problem gambling tendencies and general gambling involvement. Furthermore, it was demonstrated that gambling was associated with personality traits (impulsivity, sensation-seeking, self-control), risk attitudes, affect, and behavioural risk-taking consistent with previous research. In Study 4, it was demonstrated that measures of problem gambling have acceptable test-retest reliability. Online crowdsourcing platforms appear to offer access to samples with remarkably high proportions of problem gamblers. However, this characteristic means that such samples are not necessarily representative of gambling tendencies among more general populations.

Keywords:

• Methodology
• sampling
• data collection
• crowdsourcing
• gambling
• risk taking

Notes

1. We note that participants who did not complete wave two reported significantly higher PGSI scores (t = 2.54, p = .01) and were significantly younger (t = -2.34, p = .02) than those who returned to complete wave two, although the effect sizes of these differences were small (ds of .27 and .25, respectively).