References
- Chmielewski, Michael, and Sarah C. Kucker. 2020. “An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results.” Social Psychological and Personality Science 11 (4):464–73. doi:https://doi.org/10.1177/1948550619875149
- Peer, Eyal, Sonam Samat, Laura Brandimarte, and Alessandro Acquisti. 2015. “Beyond the Turk: An Empirical Comparison of Alternative Platforms for Crowdsourcing Online Research.” Advances in Consumer Research 43:18–22.
- Aguinis, Herman, Isabel Villamor, and Ravi S. Ramani. 2021. “MTurk Research: Review and Recommendations.” Journal of Management 47 (4):823–37. doi:https://doi.org/10.1177/0149206320969787
- Berry, Christopher, Scot Burton, and Elizabeth Howlett. 2017. “It’s Only Natural: The Mediating Impact of Consumers’ Attribute Inferences on the Relationships between Product Claims, Perceived Product Healthfulness, and Purchase Intentions.” Journal of the Academy of Marketing Science 45 (5):698–719. doi:https://doi.org/10.1007/s11747-016-0511-8
- Boas, Tyler C., Dino P. Christenson, and David M. Glick. 2020. “Recruiting Large Online Samples in the United States and India: Facebook, Mechanical Turk, and Qualtrics.” Political Science Research and Methods 8 (2):232–50. doi:https://doi.org/10.1017/psrm.2018.28
- Bohannon, John. 2011. “Human Subject Research. Social Science for Pennies.” Science 334 (6054):307. doi:https://doi.org/10.1126/science.334.6054.307
- Burton, Scot, and Edward Blair. 1991. “Task Conditions, Response Formulation Processes, and Response Accuracy for Behavioral Frequency Questions.” Public Opinion Quarterly 55 (1):50–79. doi:https://doi.org/10.1086/269241
- Burton, Scot, Jeremy Kees, Christopher Berry, and J. Craig Andrews. 2022. “Understanding How the Source of Online Consumer Data Affects Quality and Conclusions Drawn for Policy-Relevant Research.” In Marketing and Public Policy Conference, Chicago, IL: American Marketing Association.
- Callegaro, Mario, Reginald P. Baker, Jelke Bethlehem, Anja S. Goritz, Jon A. Krosnick, and Paul J. Lavrakas. 2014. Online Panel Research: A Data Quality Perspective. Wiley.
- Cannell, Charles F., Peter V. Miller, and Lois Oksenberg. 1981. “Research on Interviewing Techniques.” Sociological Methodology 12:389–437. doi:https://doi.org/10.2307/270748
- Casler, Krista, Lydia Bickel, and Elizabeth Hackett. 2013. “Separate but Equal? A Comparison of Participants and Data Gathered via Amazon’s MTurk, Social Media, and Face-to-Face Behavioral Testing.” Computers in Human Behavior 29 (6):2156–60. doi:https://doi.org/10.1016/j.chb.2013.05.009
- Chandler, Jesse, Cheskie Rosenzweig, Aaron J. Moss, Jonathan Robinson, and Leib Litman. 2019. “Online Panels in Social Science Research: Expanding Sampling Methods beyond Mechanical Turk.” Behavior Research Methods 51 (5):2022–38. doi:https://doi.org/10.3758/s13428-019-01273-7
- Chandler, Jesse, Gabriele Paolacci, Eyal Peer, Pam Mueller, and Kate A. Ratliff. 2015. “Using Nonnaive Participants Can Reduce Effect Sizes.” Psychological Science 26 (7):1131–9. doi:https://doi.org/10.1177/0956797615585115
- Chandler, Jesse, Pam Mueller, and Gabriele Paolacci. 2014. “Nonnaïveté among Amazon Mechanical Turk Workers: Consequences and Solutions for Behavioral Researchers.” Behavior Research Methods 46 (1):112–30. doi:https://doi.org/10.3758/s13428-013-0365-7
- De Pelsmacker, Patrick. 2021. “What Is Wrong with Advertising Research and How Can We Fix It?” International Journal of Advertising 40 (5):835–48. doi:https://doi.org/10.1080/02650487.2020.1827895
- Fleischer, Avi, Alan Mead, and Jialin Huang. 2015. “Inattentive Responding in MTurk and Other Online Samples.” Industrial and Organizational Psychology 8 (2):196–202. doi:https://doi.org/10.1017/iop.2015.25
- Ford, J. B. 2017. “Amazon's Mechanical Turk: A Comment.” Journal of Advertising 46 (1):156–8. doi:https://doi.org/10.1080/00913367.2016.1277380
- Goodman, Joseph K., Cynthia E. Cryder, and Amar Cheema. 2013. “Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples.” Journal of Behavioral Decision Making 26 (3):213–24. doi:https://doi.org/10.1002/bdm.1753
- Hauser, David, Gabriele Paolacci, and Jesse Chandler. 2019. “Common Concerns with MTurk as a Participant Pool: Evidence and Solutions.” In Handbook of Research Methods in Consumer Psychology, edited by F. R. Kardes, P. M. Herr, and N. Schwarz, 319–37. New York: Routledge/Taylor & Francis Group.
- Hayes, Andrew. 2018. Introduction to Mediation, Moderation, and Conditional Process Analysis. New York: The Guilford Press.
- Inzlicht, Michael, Amitai Shenhav, and Christoper Olivola. 2018. “The Effort Paradox: Effort is Both Costly and Valued.” Trends in Cognitive Sciences 22 (4):337–49. doi:https://doi.org/10.1016/j.tics.2018.01.007
- Johnson, Eric, and John Payne. 1985. “Effort and Accuracy in Choice.” Management Science 31 (4):395–414. doi:https://doi.org/10.1287/mnsc.31.4.395
- Kan, Irene P., and Anna B. Drummey. 2018. “Do Imposters Threaten Data Quality? An Examination of Worker Misrepresentation and Downstream Consequences in Amazon’s Mechanical Turk Workforce.” Computers in Human Behavior 83:243–53. doi:https://doi.org/10.1016/j.chb.2018.02.005
- Kees, Jeremy, Chris Berry, Scot Burton, and Kim Sheehan. 2017. “An Analysis of Data Quality: Professional Panels, Student Subject Pools, and Amazon’s Mechanical Turk.” Journal of Advertising 46 (1):141–55. doi:https://doi.org/10.1080/00913367.2016.1269304
- Keith, Melissa G., Louis Tay, and Peter D. Harms. 2017. “Systems Perspective of Amazon Mechanical Turk for Organizational Research: Review and Recommendations.” Frontiers in Psychology 8:1359. doi:https://doi.org/10.3389/fpsyg.2017.01359
- Kennedy, Ryan, Scott Clifford, Tyler Burleigh, Phillip D. Waggoner, Ryan Jewell, and Nicholas J. Winter. 2020. “The Shape of and Solutions to the MTurk Quality Crisis.” Political Science Research and Methods 8 (4):614–629. doi:https://doi.org/10.1017/psrm.2020.6
- Krosnick, Jon A. 1991. “Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys.” Applied Cognitive Psychology 5 (3):213–236. doi:https://doi.org/10.1002/acp.2350050305
- Levitin, Daniel J. 2014. The Organized Mind: Thinking Straight in the Age of Information Overload. New York: Plume/Penguin Books.
- Liberali, Jordan M., Reyna, Valerie F. Sarah Furlan, S. Lillian Stein, and Seth T. Pardo. 2012. “Individual Differences in Numeracy and Cognitive Reflection, with Implications for Biases and Fallacies in Probability Judgment.” Journal of Behavioral Decision Making 25 (4):361–381. doi:https://doi.org/10.1002/bdm.752
- Lin, Lin, Deborah Cockerham, Zhengsi Chang, and Gloria Natividad. 2016. “Task Speed and Accuracy Decrease When Multitasking.” Technology, Knowledge and Learning 21 (3):307–23. doi:https://doi.org/10.1007/s10758-015-9266-4
- Litman, Leib, and Jonathan Robinson. 2020. Conducting Online Research on Amazon Mechanical Turk and Beyond. Los Angeles: Sage.
- Litman, Leib, Cheskie Rosenzweig, and Aaron Moss. 2021. “New Solutions Dramatically Improve Research Data Quality on MTurk.” https://www.cloudresearch.com/resources/blog/new-tools-improve-research-data-quality-mturk/.
- McCredie, Morgan N., and Leslie C. Morey. 2019. “Who Are the Turkers? A Characterization of MTurk Workers Using the Personality Assessment Inventory.” Assessment 26 (5):759–66. doi:https://doi.org/10.1177/1073191118760709
- Misuraca, Raffaella, Palmira Faraci, Amelia Gangemi, Floriana A. Carmeci, and Silvana Miceli. 2015. “The Decision Making Tendency Inventory: A New Measure to Assess Maximizing, Satisficing, and Minimizing.” Personality and Individual Differences 85:111–116. doi:https://doi.org/10.1016/j.paid.2015.04.043
- Owens, Joel, and Erin M. Hawkins. 2019. “Using Online Labor Market Participants for Nonprofessional Investor Research: A Comparison of MTurk and Qualtrics Samples.” Journal of Information Systems 33 (1):113–128. doi:https://doi.org/10.2308/isys-52036
- Peer, Eyal, Joachim Vosgerau, and Alessandro Acquisti. 2014. “Reputation as a Sufficient Condition for Data Quality on Amazon Mechanical Turk.” Behavior Research Methods 46 (4):1023–1031. doi:https://doi.org/10.3758/s13428-013-0434-y
- Roberts, Caroline, Emily Gilbert, Nick Allum, and Léïla Eisner. 2019. “Research Synthesis: Satisficing in Surveys: A Systematic Review of the Literature.” Public Opinion Quarterly 83 (3):598–626. doi:https://doi.org/10.1093/poq/nfz035
- Rouse, Steve V. 2020. “Reliability of MTurk Data from Masters and Workers.” Journal of Individual Differences 41 (1):30–36. doi:https://doi.org/10.1027/1614-0001/a000300
- Sheehan, Kim, and Matthew Pittman. 2016. The Academic Researcher’s Guide to Mechanical Turk. Irvine: Melvin and Leigh.
- Simon, Herbert A. 1957. Models of Man: Social and Rational. New York: Wiley.
- Smith, Scott M., Catherine A. Roster, Linda L. Golden, and Gerald S. Albaum. 2016. “A Multi-Group Analysis of Online Survey Respondent Data Quality: Comparing a Regular USA Consumer Panel to MTurk Samples.” Journal of Business Research 69 (8):3139–48. doi:https://doi.org/10.1016/j.jbusres.2015.12.002
- Stewart, Neil, Jesse Chandler, and Gabriele Paolacci. 2017. “Crowdsourcing Samples in Cognitive Science.” Trends in Cognitive Sciences 21 (10):736–748. doi:https://doi.org/10.1016/j.tics.2017.06.007
- Tourangeau, Roger, Lance J. Rips, and Kenneth Rasinski. 2000. The Psychology of Survey Response. Cambridge, UK: Cambridge University Press.
- Walter, Sheryl, Scott E. Seibert, Daniel Goering, and Ernest H. O’Boyle. Jr 2019. “A Tale of Two Sample Sources: Do Results from Online Panel Data and Conventional Data Converge?” Journal of Business and Psychology 34 (4):425–452. doi:https://doi.org/10.1007/s10869-018-9552-y
- Wood, Dustin, P. D. Harms, Graham H. Lowman, and Justin A. DeSimone. 2017. “Response Speed and Response Consistency as Mutually Validating Indicators of Data Quality in Online Samples.” Social Psychological and Personality Science 8 (4):454–64. doi:https://doi.org/10.1177/1948550617703168
- Zallot, Camilla, Gabriele Paolacci, Jesse Chandler, and Itay Sisso. 2021. “Crowdsourcing in Observational and Experimental Research.” In Handbook of Computational Social Science: Science, Statistical Modelling, and Machine Learning Methods, Vol. 2, edited by Uwe Engel, Anabel Quan-Haase, Sunny Xun Liu, and Lars Lyberg. New York: Routledge.
- Zhang, Bingbing, and Sherice Gearhart. 2020. “Collecting Online Survey Data: A Comparison of Data Quality among a Commercial Panel & MTurk.” Survey Practice 13 (1):1–10. doi:https://doi.org/10.29115/SP-2020-0015