The use of sampling methods in advertising research: a gap between theory and practice

References

• Aaker, D.A., V. Kumar, R.P. Leone, and G. S. Day. 2013. Marketing research. 11th ed. Hoboken, NJ: Wiley.
   Google Scholar
• Assael, H., and J. Keon. 1982. Nonsampling vs. sampling errors in survey research. Journal of Marketing Research 46, no. 2: 114–23.
   Google Scholar
• Baker, R., S.J. Blumberg, J.M. Brick, M.P. Couper, M. Courtright, J.M. Dennis, D. Dillman, et al. 2010. Research synthesis AAPOR report on online panels. Public Opinion Quarterly 74, no. 4: 711–81.
   Web of Science ®Google Scholar
• Baker, R., J.M. Brick, N.A. Bates, M. Battaglia, M.P. Couper, J.A. Dever, K.J. Gile, and R. Tourangeau. 2013. Non-probability sampling. Report of the AAPOR task force on non-probability sampling. http://www.aapor.org/AAPOR_Main/media/MainSiteFiles/NPS_TF_Report_Final_7_revised_FNL_6_22_13.pdf (accessed May 28, 2017).
   Google Scholar
• Berinsky, A.J., G.A. Huber, and G.S. Lenz. 2012. Evaluating online labor markets for experimental research: Amazon. com's Mechanical Turk. Political Analysis 20, no. 3: 351–68.
   Web of Science ®Google Scholar
• Bethlehem, J. 2010. Selection bias in web surveys. International Statistical Review 78, no. 2: 161–88.
   Web of Science ®Google Scholar
• Biernacki, P., and D. Waldorf. 1981. Snowball sampling: Problem and techniques of chain referral sampling. Sociological Methods and Research 10, no. 2: 141–63.
   Web of Science ®Google Scholar
• Bohannon, J. 2016. Mechanical Turk upends social sciences. Science 352, no. 6291: 1263–4.
   PubMed Web of Science ®Google Scholar
• Bollen, K.A., and A. Diamantopoulos. 2017. In defense of causal–formative indicators: A minority report. Psychological Methods: forthcoming.
   Web of Science ®Google Scholar
• Bradley, N. 2013. Marketing research: Tools and techniques. 3rd ed. Oxford: Oxford University Press.
   Google Scholar
• Brick, J.M. 2011. The future of survey sampling. Public Opinion Quarterly 75, no. 5: 872–88.
   Web of Science ®Google Scholar
• Brick, J.M. 2013. Unit nonresponse and weighting adjustments: A critical review. Journal of Official Statistics 29, no. 3: 329–53.
   Web of Science ®Google Scholar
• Brick, J.M., and G. Kalton. 1996. Handling missing data in survey research. Statistical Methods in Medical Research 5, no. 3: 215–38.
   PubMedGoogle Scholar
• Buhrmester, M., T. Kwang, and S.D. Gosling. 2011. Amazon's Mechanical Turk a new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science 6, no. 1: 3–5.
   Web of Science ®Google Scholar
• Burns, A.C., and R.F. Bush. 2014. Marketing research. 7th ed. Upper Saddle River, NJ: Pearson/Prentice Hall.
   Google Scholar
• Calder, B.J., L.W. Phillips, and A.M. Tybout. 1981. Designing research for application. Journal of Consumer Research 8, no. 2: 197–207.
   Web of Science ®Google Scholar
• Chandler, J., P. Mueller, and G. Paolacci. 2014. Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers. Behavior Research Methods 46, no. 1: 112–30.
   PubMed Web of Science ®Google Scholar
• Chang, L., and J.A. Krosnick. 2009. National surveys via RDD telephone interviewing versus the internet comparing sample representativeness and response quality. Public Opinion Quarterly 73, no. 4: 641–78.
   Web of Science ®Google Scholar
• Cochran, W.G. 1977. Sampling techniques. 3rd ed. New York: John Wiley and Sons.
   Google Scholar
• Coleman, J.S. 1958. Relational analysis: The study of social organizations with survey methods. Human Organization 17, no. 4: 28–36.
   Web of Science ®Google Scholar
• Cook, T.D., D.T. Campbell, and A. Day. 1979. Quasi-experimentation: Design and analysis issues for field settings. Boston, MA: Houghton Mifflin.
   Google Scholar
• Cooke, M. 2017. Is technological change threatening the very existence of “traditional” survey research and, if so, what should we do about it? International Journal of Market Research 59, no. 2: 153–5.
   Web of Science ®Google Scholar
• Couper, M.P., and M. Bosnjak. 2010. Internet surveys. In Handbook of survey research, eds. J.D. Wright and P.V. Marsden, 527–550. Bingley: Emerald Group Publishing Ltd.
   Google Scholar
• Deville, J.C., C.E. Särndal, and O. Sautory. (1993). Generalized raking procedures in survey sampling. Journal of the American statistical Association 88, no. 423: 1013–20.
   Web of Science ®Google Scholar
• Easley, R.W., C.S. Madden, and V. Gray. 2013. A tale of two cultures: Revisiting journal editors' views of replication research. Journal of Business Research 66, no. 9: 1457–9.
   Web of Science ®Google Scholar
• East, R. 2016. Bias in the evaluation of research methods. Marketing Theory 16, no. 2: 219–31.
   Web of Science ®Google Scholar
• Eisend, M. 2015. Persuasion knowledge and third-person perceptions in advertising: The moderating effect of regulatory competence. International Journal of Advertising 34, no. 1: 54–69.
   Web of Science ®Google Scholar
• Ellison, S.L.R., T.J. Farrant, and V. Barwick. 2009. Practical statistics for the analytical scientist: A bench guide. 2nd ed. Cambridge: Royal Society of Chemistry.
   Google Scholar
• Ferber, R. 1977. Research by convenience. Journal of Consumer Research 4, no. 1: 57–8.
   Web of Science ®Google Scholar
• Freeman, D., and S. Shapiro. 2014. Tweens’ knowledge of marketing tactics. Skeptical beyond their years. Journal of Advertising Research 54, no. 1: 44–55.
   Web of Science ®Google Scholar
• Fricker, R. D. Jr. 2016. Sampling methods for online surveys. In The SAGE handbook of online research methods, eds. N. G. Fielding, R. M. Lee, and G. Blank, 162–83. London: Sage.
   Google Scholar
• Gneezy, A. 2017. Field experimentation in marketing research. Journal of Marketing Research 54, no. 1: 140–3.
   Web of Science ®Google Scholar
• Goodman, J.K., C.E. Cryder, and A. Cheema. 2013. Data collection in a flat world: The strengths and weaknesses of Mechanical Turk samples. Journal of Behavioral Decision Making 26, no. 3: 213–24.
   Web of Science ®Google Scholar
• Hair, J.F., M. Sarstedt, T.M. Pieper, and C.M. Ringle. 2012. The use of partial least squares structural equation modeling in strategic management research: A review of past practices and recommendations for future applications. Long Range Planning 45, no. 5: 320–40.
   Web of Science ®Google Scholar
• Hair, J.F., M. Sarstedt, C.M. Ringle, and J.A. Mena. 2012. An assessment of the use of partial least squares structural equation modeling in marketing research. Journal of the Academy of Marketing Science 40, no. 3: 414–33.
   Web of Science ®Google Scholar
• Hair, J.F., M. Wolfinbarger Celsi, A. Money, P. Samouel, and M. Page. 2015. Essentials of business research methods. 3rd. ed. Armonk, NY: ME Sharpe.
   Google Scholar
• Hair, J.F., M. Wolfinbarger Celsi, D.J. Ortinau, and R.P. Bush. 2013. Essentials of marketing research. 3rd ed. Irwin, SC: McGraw-Hill.
   Google Scholar
• Henseler, J., C.M. Ringle, and M. Sarstedt. 2015. Testing measurement invariance of composites using partial least squares. International Marketing Review 33, no. 3: 405–31.
   Web of Science ®Google Scholar
• Iacobucci, D., and G. Churchill. 2010. Marketing research: Methodological foundations. 10th ed. Mason, OH: Thomson/South-Western.
   Google Scholar
• Kalton, G. 2009. Methods of oversampling rare population in social surveys. Survey Methodology 35, no. 2: 125–41.
   Web of Science ®Google Scholar
• Kalton, G., and I. Flores-Cervantes. 2003. Weighting methods. Journal of Official Statistics 19, no. 2: 81–97.
   Google Scholar
• Kaplan, A. 1964. The conduct of inquiry. San Francisco, CA: Chandler.
   Google Scholar
• Kukull, W.A., and M. Ganguli. 2012. Generalizability: The trees, the forest, and the low-hanging fruit. Neurology 78, no. 23: 1886–91.
   PubMed Web of Science ®Google Scholar
• Kuppelwieser, V., and M. Sarstedt. 2014. Applying the future time perspective scale to advertising research. International Journal of Advertising 33, no. 1: 113–36.
   Web of Science ®Google Scholar
• Lee, S. 2006. Propensity score adjustment as a weighting scheme for volunteer panel web surveys. Journal of Official Statistics 22, no. 2: 329–49.
   Google Scholar
• Lehmann, S., and P. Bengart. 2016. Replications hardly possible: Reporting practice in top-tier marketing journals. Journal of Modelling in Management 11, no. 2: 427–45.
   Web of Science ®Google Scholar
• Lehmann, D.R., L. McAlister, and R. Staelin. 2011. Sophistication in research in marketing. Journal of Marketing 75, no. 4: 155–65.
   Web of Science ®Google Scholar
• Levy, P.S., and S. Lemeshow, eds. 2013. Sampling of populations: Methods and applications. 5th ed. Hoboken, NJ: John Wiley and Sons.
   Google Scholar
• Lichters, M., M. Sarstedt, and B. Vogt. 2015. On the practical relevance of the attraction effect: A cautionary note and guidelines for context effect experiments. AMS Review 5, no. 1–2: 1–19.
   Google Scholar
• Lucas, J.W. 2003. Theory-testing, generalization, and the problem of external validity. Sociological Theory 21, no. 3: 236–53.
   Web of Science ®Google Scholar
• Lynch, Jr., J.G. 1982. On the external validity of experiments in consumer research. Journal of Consumer Research 9, no. 3: 225–39.
   Web of Science ®Google Scholar
• Lynch, J.G. 1999. Theory and external validity. Journal of the Academy of Marketing Science 27, no. 3: 367–76.
   Web of Science ®Google Scholar
• Lynch, J.G., J.W. Alba, A. Krishn, V.G. Morwitz, and Z. Gürhan-Canli. 2012. Knowledge creation in consumer research: Multiple routes, multiple criteria. Journal of Consumer Psychology 22, no. 4: 473–85.
   Web of Science ®Google Scholar
• Malhotra, N.K., and J.A. Krosnick. 2007. The effect of survey mode and sampling on inferences about political attitudes and behavior: Comparing the 2000 and 2004 ANES to Internet surveys with nonprobability samples. Political Analysis 15, no. 3: 286–323.
   Web of Science ®Google Scholar
• Malhotra, N.K. 2010. Marketing research: An applied orientation. 6th ed. Upper Saddle River, NJ: Pearson Education.
   Google Scholar
• Malhotra, N.K., D.F. Birks, and P. Wills. 2012. Marketing research: An applied approach. 4th ed. London: Pearson Education.
   Google Scholar
• Marshall, M.N. 1996. Sampling for qualitative research. Family Practice 13, no. 6: 522–6.
   PubMed Web of Science ®Google Scholar
• McDaniel, C.D., and R.H. Gates. 2015. Marketing research. 10th ed. Hoboken, NJ: Wiley.
   Google Scholar
• McGivern, Y. 2009. The practice of market and social research: An introduction. 3rd ed. Harlow: Pearson Education.
   Google Scholar
• McGrath, J.E., and D. Brinberg. 1983. External validity and the research process: A comment on the Calder/Lynch dialogue. Journal of Consumer Research 10, no. 1: 115–24.
   Web of Science ®Google Scholar
• Moser, C.A., and A. Stuart. 1953. An experimental study of quota sampling. Journal of the Royal Statistical Society Series A (General) 116, no. 4: 349–405.
   Web of Science ®Google Scholar
• Oh, H.L., and F. Scheuren. 1983. Weighting adjustments for unit nonresponse. In Incomplete data in sample surveys, 2nd ed., eds. W.G. Madow, I. Olkin, and D.B. Rubin, 143–84. New York: Academic Press.
   Google Scholar
• Olivier, L. 2011. River sampling non-probability sampling in an online environment. Web log, November 13, 2011. Center for Information-Based Decision Making and Marketing Research. http://lexolivier.blogspot.com/2011/11/river-sampling-non-probabilitysampling.html.
   Google Scholar
• Quinlan, C. 2011. Business research methods. Andover: South-Western Cengage Learning.
   Google Scholar
• Reibstein, D.J., G. Day, and J. Wind. 2009. Guest editorial: Is marketing academia losing its way? Journal of Marketing 73, no. 4: 1–3.
   Web of Science ®Google Scholar
• Salzberger, T., M. Sarstedt, and A. Diamantopoulos. 2016. Measurement in the social sciences: Where C-OAR-SE delivers and where it does not. European Journal of Marketing 50, no. 11: 1942–52.
   Web of Science ®Google Scholar
• Sarstedt, M., A. Diamantopoulos, T. Salzberger, and P. Baumgartner. 2016. Selecting single items to measure doubly concrete constructs: A cautionary tale. Journal of Business Research 69, no. 8, 3159–67.
   Web of Science ®Google Scholar
• Sarstedt, M., and E. Mooi. 2014. A concise guide to market research: The process, data, and methods using IBM SPSS Statistics. 2nd ed. Berlin: Springer Berlin.
   Google Scholar
• Smith, S.M., C.A. Roster, L.L. Golden, and G.S. Albaum. 2016. A multi-group analysis of online survey respondent data quality: Comparing a regular USA consumer panel to MTurk samples. Journal of Business Research 69, no. 8: 3139–48.
   Web of Science ®Google Scholar
• Soldz, S., and G.E. Vaillant. 1999. The Big Five personality traits and the life course: A 45-year longitudinal study. Journal of Research in Personality 33, no. 2: 208–32.
   Web of Science ®Google Scholar
• Stephan, F.F., and P.J. McCarthy. 1958. Sampling opinions: An analysis of survey procedure. Oxford: John Wiley and Sons.
   Google Scholar
• Stephenson, C.B. 1979. Probability sampling with quotas: An experiment. Public Opinion Quarterly 43, no. 4: 477–96.
   Web of Science ®Google Scholar
• Stuart, A. 1976. Basic ideas of scientific sampling. London: Griffin.
   Google Scholar
• Sturgis, P.N. Baker, M. Callegaro, S. Fisher, J. Green, W. Jennings, J. Kuha, B. Lauderdale, and P. Smith. 2016. Report of the inquiry into the 2015 British general election opinion polls. London: Market Research Society and British Polling Council.
   Google Scholar
• Tull, D.S., and D.I. Hawkins. 1993. Marketing research: Measurement and method. 6th ed. New York: MacMillan.
   Google Scholar
• Wessling, S.K., J. Huber, and O. Netzer. 2017. MTurk character misrepresentation: Assessment and solutions. Journal of Consumer Research 44, no. 1: 211–30.
   Web of Science ®Google Scholar
• Wind, Y.J. 2014. Toward a new marketing paradigm. In The Routledge companion to the future of marketing, eds. L. Mouthinho, E. Bigné, and A.K. Manrai, 3–24. New York: Routledge, Taylor and Francis Group.
   Google Scholar
• Yeager, D.S., J.A. Krosnick, L. Chang, H.S. Javitz, M.S. Levendusky, A. Simpser, and R. Wang. 2011. Comparing the accuracy of RDD telephone surveys and internet surveys and non-probability samples. Public Opinion Quarterly 75, no. 4: 709–47.
   Web of Science ®Google Scholar
• Zikmund, W., B. Babin, J. Carr, and M. Griffin. 2012. Business research methods. Mason, OH: South-Western Cengage Learning.
   Google Scholar