Bots and nots: safeguarding online survey research with underrepresented and diverse populations

References

• Ballard, A. M., Cardwell, T., & Young, A. M. (2019). Fraud detection protocol for web-based research among men who have sex with men: Development and descriptive evaluation. JMIR Public Health Surveillance, 5(1), e12344–e12344. https://doi.org/10.2196/12344
   PubMedGoogle Scholar
• Beckford Jarrett, S., Flanagan, R., Coriolan, A., Harris, O., Campbell, A., & Skyers, N. (2020). Barriers and facilitators to participation of men who have sex with men and transgender women in HIV research in Jamaica. Culture, Health & Sexuality, 22(8), 887–903. https://doi.org/10.1080/13691058.2019.1634222
   PubMed Web of Science ®Google Scholar
• Centers for Disease Control and Prevention [CDC]. (2020, February 13). Collecting sexual orientation and gender identity information: Importance of the collection and use of these data. https://www.cdc.gov/hiv/clinicians/transforming-health/health-care-providers/collecting-sexual-orientation.html
   Google Scholar
• Chandler, J., Sisso, I., & Shapiro, D. (2020). Participant carelessness and fraud: Consequences for clinical research and potential solutions. Journal of Abnormal Psychology, 129(1), 49–55. https://doi.org/10.1037/abn0000479
   PubMed Web of Science ®Google Scholar
• Christensen, T., Riis, A. H., Hatch, E. E., Wise, L. A., Nielsen, M. G., Rothman, K. J., Toft Sørensen, H., & Mikkelsen, E. M. (2017). Costs and efficiency of online and offline recruitment methods: A web-based cohort study. Journal of Medical Internet Research, 19(3), e58–e58. https://doi.org/10.2196/jmir.6716
   PubMed Web of Science ®Google Scholar
• Dewitt, J., Capistrant, B., Kohli, N., Rosser, B. R. S., Mitteldorf, D., Merengwa, E., & West, W. (2018). Addressing participant validity in a small internet health survey (The restore study): Protocol and recommendations for survey response validation. JMIR Research Protocols, 7(4), e96–e96. https://doi.org/10.2196/resprot.7655
   PubMed Web of Science ®Google Scholar
• Ferrara, E., Varol, O., Davis, C., Menczer, F., & Flammini, A. (2016). The rise of social bots. Communications of the Association for Computing Machinery, 59(7), 96–104. https://doi.org/10.1145/2818717
   Web of Science ®Google Scholar
• Godinho, A., Schell, C., & Cunningham, J. A. (2020). Out damn bot, out: Recruiting real people into substance use studies on the internet. Substance Abuse, 41(1), 3–5. https://doi.org/10.1080/08897077.2019.1691131
   PubMed Web of Science ®Google Scholar
• Grey, J. A., Konstan, J., Iantaffi, A., Wilkerson, J. M., Galos, D., & Rosser, B. R. (2015). An updated protocol to detect invalid entries in an online survey of men who have sex with men (MSM): How do valid and invalid submissions compare? AIDS Behavior, 19(10), 1928–1937. https://doi.org/10.1007/s10461-015-1033-y
   PubMed Web of Science ®Google Scholar
• Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009). Research electronic data capture (REDCap®)-A metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics, 42(2), 377–381. https://doi.org/10.1016/j.jbi.2008.08.010
   PubMed Web of Science ®Google Scholar
• Heckel, L., Gunn, K. M., & Livingston, P. M. (2018). The challenges of recruiting cancer patient/caregiver dyads: Informing randomized controlled trials. BMC Medical Research Methodology, 18(1), 146. https://doi.org/10.1186/s12874-018-0614-7
   PubMedGoogle Scholar
• Kaplan, C. P., Siegel, A., Leykin, Y., Palmer, N. R., Borno, H., Bielenberg, J., Livaudais-Toman, J., Ryan, C., & Small, E. J. (2018). A bilingual, Internet-based, targeted advertising campaign for prostate cancer clinical trials: Assessing the feasibility, acceptability, and efficacy of a novel recruitment strategy. Contemporary Clinical Trials Communications, 12, 60–67. https://doi.org/10.1016/j.conctc.2018.08.005
   PubMed Web of Science ®Google Scholar
• Knepper, D., Fenske, C., Nadolny, P., Bedding, A., Gribkova, E., Polzer, J., Neumann, J., Wilson, B., Benedict, J., & Lawton, A. (2016). Detecting data quality issues in clinical trial: Current practices and recommendations. Therapeutic Innovation & Regulatory Science, 50(1), 15–21. https://doi.org/10.1177/2168479015620248
   PubMed Web of Science ®Google Scholar
• Konstan, J. A., Simon Rosser, B. R., Ross, M. W., Stanton, J., & Edwards, W. M. (2006). The Story of subject naught: A Cautionary but optimistic tale of internet survey research. Journal of Computer-Mediated Communication, 10(2), 00–00. https://doi.org/10.1111/j.1083-6101.2005.tb00248.x
   Web of Science ®Google Scholar
• Latah, M. (2020). Detection of malicious social bots: A survey and a refined taxonomy. Expert Systems with Applications, 151, 113383. https://doi.org/10.1016/j.eswa.2020.113383d
   Google Scholar
• McInroy, L. B. (2016). Pitfalls, potentials, and ethics of online survey research: LGBTQ and other marginalized and hard-to-access youths. Social Work Research, 40(2), 83–94. https://doi.org/10.1093/swr/svw005
   PubMed Web of Science ®Google Scholar
• McInroy, L. B., & Beer, O. W. (2021). Adapting vignettes for internet-based research: Eliciting realistic responses to the digital milieu. International Journal of Social Research Methodology, 1–13. https://doi.org/10.1080/13645579.2021.1901440
   Google Scholar
• Page, K. R., Castillo-Page, L., Poll-Hunter, N., Garrison, G., & Wright, S. M. (2013). Assessing the evolving definition of underrepresented minority and its application in academic medicine. Academic Medicine, 88(1), 67–72. https://doi.org/10.1097/ACM.0b013e318276466c
   Google Scholar
• Pew Research Center. (2014, February 11). Couples, the internet, and social media. https://www.pewresearch.org/internet/2014/02/11/couples-the-internet-and-social-media/
   Google Scholar
• Pew Research Center. (2019, June 12). Internet/Broadband fact sheet. https://www.pewresearch.org/internet/fact-sheet/internet-broadband/
   Google Scholar
• Pozzar, R., Hammer, M. J., Underhill-Blazey, M., Wright, A. A., Tulsky, J. A., Hong, F., Gundersen, D. A., & Berry, D. L. (2020). Threats of bots and other bad actors to data quality following research participant recruitment through social media: Cross-sectional questionnaire. Journal of Medical Internet Research, 22(10), e23021–e23021. https://doi.org/10.2196/23021
   PubMed Web of Science ®Google Scholar
• Prolific. (2020, February 13). How it works. https://www.prolific.co/#how-it-works
   Google Scholar
• Quach, S., Pereira, J. A., Russell, M. L., Wormsbecker, A. E., Ramsay, H., Crowe, L., Quan, S. D., & Kwong, J. (2013). The good, bad, and ugly of online recruitment of parents for health-related focus groups: Lessons learned. Journal of Medical Internet Research, 15(11), e250. https://doi.org/10.2196/jmir.2829
   PubMed Web of Science ®Google Scholar
• Rizzo, L., & Click, S. (2020, August 15). How Covid-19 changed American’s internet habits. The Wall Street Journal. Eastern Edition. https://www.wsj.com/articles/coronavirus-lockdown-tested-internets-backbone-11597503600
   Google Scholar
• Tedeschi, R. G., & Calhoun, L. G. (1995). Trauma and transformation: Growth in the aftermath of suffering. Sage Publications.
   Google Scholar
• Teitcher, J. E., Bockting, W. O., Bauermeister, J. A., Hoefer, C. J., Miner, M. H., & Klitzman, R. L. (2015). Detecting, preventing, and responding to “fraudsters” in internet research: Ethics and tradeoffs. Journal of Law, Medicine, and Ethics, 43(1), 116–133. https://doi.org/10.1111/jlme.12200
   PubMed Web of Science ®Google Scholar
• Watson, N. L., Mull, K. E., Heffner, J. L., McClure, J. B., & Bricker, J. B. (2018). Participant recruitment and retention in remote eHealth intervention trials: Methods and lessons learned from a large randomized controlled trial of two web-based smoking interventions. Journal of Medical Internet Research, 20(8), e10351–e10351. https://doi.org/10.2196/10351
   PubMed Web of Science ®Google Scholar
• Whitehead, J., Shaver, J., & Stephenson, R. (2016). Outness, stigma, and primary health care utilization among rural LGBT populations. PLoS One, 11(1), e0146139. https://doi.org/10.1371/journal.pone.0146139
   PubMed Web of Science ®Google Scholar