Do instructional manipulation checks measure inattention or miscomprehension?

References

• Anduiza, E., & Galais, C. (2017). Answering without reading: IMCs and strong satisficing in online surveys. International Journal of Public Opinion Research, 29(3), 497–519. https://doi.org/10.1093/ijpor/edw007
   Web of Science ®Google Scholar
• Basa-Martinez, D. D. F., Cabrera, J. Y., Dionaldo, L. G., Orillo, J. G. R., Ramos, P. J. M., & Ocampo, L. A. (2018). An exploration of a respondent pre-qualifying framework to increase response rates in social media initiated online surveys. Australasian Marketing Journal, 26(3), 239–261. https://doi.org/10.1016/j.ausmj.2018.04.001
   Web of Science ®Google Scholar
• Baumgartner, H., Weijters, B., & Pieters, R. (2018). Misresponse to survey questions: A conceptual framework and empirical test of the effects of reversals, negations, and polar opposite core concepts. Journal of Marketing Research, 55(6), 869–883. https://doi.org/10.1177/0022243718811848
   Web of Science ®Google Scholar
• Behe, B. K., Bae, M., Huddleston, P. T., & Sage, L. (2015). The effect of involvement on visual attention and product choice. Journal of Retailing and Consumer Services, 24, 10–21. https://doi.org/10.1016/j.jretconser.2015.01.002
   Web of Science ®Google Scholar
• Black, I. R., Efron, A., Ioannou, C., & Rose, J. M. (2005). Designing and implementing internet questionnaires using Microsoft excel. Australasian Marketing Journal, 13(2), 61–72. https://doi.org/10.1016/S1441-3582(05)70078-1
   Google Scholar
• Carver, R. P. (1992). Reading rate: Theory, research, and practical implications. Journal of Reading, 36(2), 84–95. http://www.jstor.org/stable/40016440
   Google Scholar
• Duchowski, A. (2007). Eye tracking methodology: Theory and practice (3 ed.). Springer.
   Google Scholar
• Espigares-Jurado, F., Muñoz-Leiva, F., Correia, M. B., Sousa, C. M., Ramos, C. M., & Faísca, L. (2020). Visual attention to the main image of a hotel website based on its position, type of navigation and belonging to Millennial generation: An eye tracking study. Journal of Retailing and Consumer Services, 52, 101906. https://doi.org/10.1016/j.jretconser.2019.101906
   Web of Science ®Google Scholar
• Galesic, M., Tourangeau, R., Couper, M. P., & Conrad, F. G. (2008). Eye-tracking data: New insights on response order effects and other cognitive shortcuts in survey responding. Public Opinion Quarterly, 72(5), 892–913. https://doi.org/10.1093/poq/nfn059
   PubMed Web of Science ®Google Scholar
• Hsu, L., & Chen, Y. J. (2020). Neuromarketing, subliminal advertising, and hotel selection: An EEG study. Australasian Marketing Journal, 28(4), 200–208. https://doi.org/10.1016/j.ausmj.2020.04.009
   Web of Science ®Google Scholar
• Huang, J. L., Curran, P. G., Keeney, J., Poposki, E. M., & DeShon, R. P. (2012). Detecting and deterring insufficient effort responding to surveys. Journal of Business and Psychology, 27(1), 99–114. https://doi.org/10.1007/s10869-011-9231-8
   Web of Science ®Google Scholar
• iMotions. (2018). AOI Metrics. help.imotions.com/hc/en-us/articles/203510212-AOI-Metrics-Reference
   Google Scholar
• Kim, J., Hwang, E., Phillips, M., Jang, S., Kim, J. E., Spence, M. T., & Park, J. (2018). Mediation analysis revisited: Practical suggestions for addressing common deficiencies. Australasian Marketing Journal, 26(1), 59–64. https://doi.org/10.1016/j.ausmj.2018.03.002
   Web of Science ®Google Scholar
• Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5(3), 213–236. https://doi.org/10.1002/acp.2350050305
   Web of Science ®Google Scholar
• Lenzner, T., Kaczmirek, L., & Galesic, M. (2011). Seeing through the eyes of the respondent: An eye-tracking study on survey question comprehension. International Journal of Public Opinion Research, 23(3), 361–373. https://doi.org/10.1093/ijpor/edq053
   Web of Science ®Google Scholar
• Lenzner, T., Kaczmirek, L., & Galesic, M. (2014). Left feels right: A usability study on the position of answer boxes in web surveys. Social Science Computer Review, 32(6), 743–764. https://doi.org/10.1177/0894439313517532
   Web of Science ®Google Scholar
• Liu, M., & Wronski, L. (2018). Trap questions in online surveys: Results from three web survey experiments. International Journal of Market Research, 60(1), 32–49. https://doi.org/10.1177/1470785317744856
   Web of Science ®Google Scholar
• Maniaci, M. R., & Rogge, R. D. (2014). Caring about carelessness: Participant inattention and its effects on research. Journal of Research in Personality, 48, 61–83. https://doi.org/10.1016/j.jrp.2013.09.008
   Web of Science ®Google Scholar
• Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17(3), 437–455. https://doi.org/10.1037/a0028085
   PubMed Web of Science ®Google Scholar
• Menold, N. (2020). Rating-scale labeling in online surveys: An experimental comparison of verbal and numeric rating scales with respect to measurement quality and respondents’ cognitive processes. Sociological Methods & Research, 49(1), 79–107. https://doi.org/10.1177/0049124117729694
   Web of Science ®Google Scholar
• Morren, M., & Paas, L. J. (2020). Short and long instructional manipulation checks: What do they measure? International Journal of Public Opinion Research, 32(4), 790–800. https://doi.org/10.1093/ijpor/edz046
   Web of Science ®Google Scholar
• Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009). Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology, 45(4), 867–872. https://doi.org/10.1016/j.jesp.2009.03.009
   Web of Science ®Google Scholar
• Paas, L. J., Dolnicar, S., & Karlsson, L. (2018). Instructional manipulation checks: A longitudinal analysis with implications for MTurk. International Journal of Research in Marketing, 35(2), 258–269. https://doi.org/10.1016/j.ijresmar.2018.01.003
   Web of Science ®Google Scholar
• Paas, L. J., & Morren, M. (2018). Please do not answer if you are reading this: Respondent attention in online panels. Marketing Letters, 29(1), 13–21. https://doi.org/10.1007/s11002-018-9448-7
   Web of Science ®Google Scholar
• Paas, L. J., & Sijtsma, K. (2008). Nonparametric item response theory for investigating dimensionality of marketing scales: A SERVQUAL application. Marketing Letters, 19(2), 157–170. https://doi.org/10.1007/s11002-007-9031-0
   Web of Science ®Google Scholar
• Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of social psychological attitudes, Vol. 1. Measures of personality and social psychological attitudes (pp. 17–59). Academic Press.
   Google Scholar
• Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124(3), 372–422. https://doi.org/10.1037/0033-2909.124.3.372
   PubMed Web of Science ®Google Scholar
• Russo, J. E. (1978). Eye fixations as a process trace. In M. Schulte-Mecklenbeck, A. Kuhberger, & R. Ranyard (Eds.), A handbook of process tracing methods for decision research: A critical review and user’s guide (pp. 43–64). Psychology Press.
   Google Scholar
• Sijtsma, K., & Molenaar, I. W. (2002). An introduction to nonparametric item response theory. Measurement methods for social sciences. Sage Publications.
   Google Scholar
• Tobii (2003). Tobii technology user manual. Retrieved from December 21, 2018 https://www.tobiipro.com/siteassets/tobii-pro/user-manuals/tobii-pro-studio-user-manual.pdf
   Google Scholar
• Wedel, M., & Pieters, R. (2008). A review of eye-tracking research in marketing. In N. K. Malhotra (Ed.), Review of Marketing Research (Vol. 4, pp. 123–147). M.E. Sharpe.
   Google Scholar