A moving target? An analysis of the impact of electoral context on polling error variation in both British and international general elections

References

• Abrams, Mark. 1970. “The Opinion Polls and the 1970 British General Election.” Public Opinion Quarterly 34: 317–324.
   Web of Science ®Google Scholar
• Albers, Casper, and Daniel Lakens. 2018. “When Power Analyses Based on Pilot Data are Biased: Inaccurate Effect Size Estimators and Follow-up Bias.” Journal of Experimental Social Psychology 74: 187–195.
   Web of Science ®Google Scholar
• Awan-Scully, Roger. 2014. “A Bit More on Uniform National Swing – and an Alternative.” Accessed February 6, 2021. https://blogs.cardiff.ac.uk/electionsinwales/2014/11/17/807/.
   Google Scholar
• Baxter, Martin. 2017. “Additive Model.” Accessed January 25, 2019. https://www.electoralcalculus.co.uk/newmodel.html#additive.
   Google Scholar
• Bliese, Paul D. 2000. “Within-Group Agreement, Non-Independence, and Reliability.” In Multilevel Theory, Research, and Methods in Organizations, edited by Katherine J. Klein, and Steve W. J. Kozlowski, 349–381. San Francisco: Jossey-Bass.
   Google Scholar
• Bobak, Carly A., Paul J. Barr, and A. James O’Malley. 2018. “Estimation of an Inter-Rater Intra-Class Correlation Coefficient That Overcomes Common Assumption Violations in the Assessment of Health Measurement.” BMC Medical Research Methodology 18: 93.
   PubMed Web of Science ®Google Scholar
• Brown-Iannuzzi, Jazmin, Maxine Najle, and Will Gervais. 2019. “The Illusion of Political Tolerance: Social Desirability and Self-Reported Voting Preferences.” Social Psychological and Personality Science 10: 364–373.
   Web of Science ®Google Scholar
• Buchanan, William. 1986. “Election Predictions: An Empirical Assessment.” The Public Opinion Quarterly 50 (2): 222–227.
   Web of Science ®Google Scholar
• Bürkner, Paul-Christian. 2017. “brms: An R Package for Bayesian Multilevel Models Using Stan.” Journal of Statistical Software 80: 1–28.
   Web of Science ®Google Scholar
• Butler, David, and Dennis Kavanagh. 1980. The British General Election of 1979. London: Macmillan Press.
   Google Scholar
• Carlin, Bradley, and Thomas Louis. 1996. “Identifying Prior Distributions That Produce Specific Decisions, with Application to Monitoring Clinical Trials.” In Bayesian Analysis in Statistics and Econometrics: Essays in Honor of Arnold Zellner, edited by Donald John, Kathryn Chaloner, and Geweke Arnold Zellner, 493–503. New York: John Wiley & Sons.
   Google Scholar
• Crespi, Irving. 1988. Pre-election Polling: Sources of Accuracy and Error. New York: Russell Sage Foundation.
   Google Scholar
• Crewe, Ivor. 1992. “A Nation of Liars? Opinion Polls and the 1992 Election.” Parliamentary Affairs 45 (4): 475–495.
   Web of Science ®Google Scholar
• Curtice, John. 2015. “A Return to Normality? How the Electoral System Operated.” Parliamentary Affairs 68 (suppl. 1): 25–40.
   Google Scholar
• Curtice, John. 2016. “EU Referendum – How the Polls Got it Wrong Again.” The Conversation, June 26. Accessed June 25, 2020. http://theconversation.com/eu-referendum-how-the-pollsgot-it-wrong-again-61639.
   Google Scholar
• Durand, Claire, and André Blais. 2019. “Quebec 2018: A Failure of the Polls?” Canadian Journal of Political Science 53 (1): 133–150.
   Web of Science ®Google Scholar
• El-Horbaty, Yahia, and Eman Hanafy. 2018. “Some Estimation Methods and Their Assessment in Multilevel Models: A Review.” Biostatistics and Biometrics Open Access Journal 5: 1–8.
   Google Scholar
• Enten, Harry. 2017. “Macron Won, But the French Polls Were Way Off.” FiveThirtyEight. Accessed June 24, 2020. https://fivethirtyeight.com/features/macron-won-but-the-french-polls-were-way-off/.
   Google Scholar
• Erikson, Robert S., and Christopher Wlezien. 2012. The Timeline of Presidential Elections: How Campaigns do (and do not) Matter. Chicago: University of Chicago Press.
   Google Scholar
• Fernée, Christianne L., and Konstantinos P. Trimmis. 2021. “Detecting Variability: A Study on the Application of Bayesian Multilevel Modelling to Archaeological Data. Evidence from the Neolithic Adriatic and the Bronze Age Aegean.” Journal of Archaeological Science 128: 105346.
   Web of Science ®Google Scholar
• Fieldhouse, Edward, Jane Green, Geoffrey Evans, Jonathan Mellon, Christopher Prosser, Hermann Schmitt, and Cees van der Eijk. 2020. Electoral Shocks: The Volatile Voter in a Turbulent World. Oxford: Oxford University Press.
   Google Scholar
• Fisher, Stephen, Robert Ford, Will Jennings, Mark Pickup, and Christopher Wlezien. 2011. “From Polls to Votes to Seats: Forecasting the 2010 British General Election.” Electoral Studies 30: 250–257.
   Web of Science ®Google Scholar
• Fisher, Stephen, and Michael Lewis-Beck. 2016. “Forecasting the 2015 British General Election: The 1992 Debacle all Over Again?” Electoral Studies 41: 225–229.
   Web of Science ®Google Scholar
• Fisher, Stephen, and Rosalind Shorrocks. 2018. “Collective Failure? Lessons from Combining Forecasts for the UK’s Referendum on EU Membership.” Journal of Elections, Public Opinion and Parties 28 (1): 59–77.
   Web of Science ®Google Scholar
• Franklin, Mark. 2004. Voter Turnout and the Dynamics of Electoral Competition in Established Democracies Since 1945. Cambridge: Cambridge University Press.
   Google Scholar
• Gelman, Andrew. 2006. “Prior Distributions for Variance Parameters in Hierarchical Models (Comment on Article by Browne and Draper).” Bayesian Analysis 1: 515–534.
   Web of Science ®Google Scholar
• Gelman, Andrew, and Jennifer Hill. 2006. Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge: Cambridge University Press.
   Google Scholar
• Goldstein, Harvey. 2011. Multilevel Statistical Models: Fourth Edition. New Jersey: John Wiley & Sons.
   Google Scholar
• Hanretty, Christopher, Benjamin Lauderdale, and Nick Vivyan. 2014. “Presenting a New Model for Forecasting the 2015 General Election.” London School of Economics British Polling and Policy Blog. Accessed March 3, 2021. https://blogs.lse.ac.uk/politicsandpolicy/presenting-a-new-model-for-forecasting-the-2015-general-election/.
   Google Scholar
• Hillygus, D. Sunshine. 2011. “The Evolution of Election Polling in the United States.” Public Opinion Quarterly 75: 962–981.
   Web of Science ®Google Scholar
• Hox, Joop J. 2002. Multilevel Analysis: Techniques and Applications – Third Edition. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Jennings, Will, Michael Lewis-Beck, and Christopher Wlezien. 2020. “‘Election Forecasting: Too far out?” International Journal of Forecasting 36 (3): 949–962.
   Web of Science ®Google Scholar
• Jennings, Will, and Christopher Wlezien. 2018. “Election Polling Errors Across Time and Space.” Nature Human Behaviour 2 (4): 276–283.
   PubMed Web of Science ®Google Scholar
• Karp, Jeffrey A., and David Brockington. 2005. “Social Desirability and Response Validity: A Comparative Analysis of Overreporting Voter Turnout in Five Countries.” Journal of Politics 67 (3): 825–840.
   Web of Science ®Google Scholar
• Kenett, Ron S., Danny Pfeffermann, and David M. Steingberg. 2018. “Election Polls – A Survey, A Critique, and Proposals.” Annual Review of Statistics and its Application 5: 1–24.
   Web of Science ®Google Scholar
• Kennedy, Courtney, Mark Blumenthal, Scott Clement, Joshua D. Clinton, Claire Durand, Charles Franklin, Kyley McGeeney, et al. 2018. “An Evaluation of the 2016 Election Polls in the United States.” Public Opinion Quarterly 82 (1): 1–33.
   Web of Science ®Google Scholar
• Koff, Stephen P. 1972. “Public Opinion Polls and the 1970 British Election.” Il Politico 37: 466–482.
   Google Scholar
• Laakso, Markku. 1979. “Should a Two-and-a-Half Law Replace the Cube Law in British Elections?” British Journal of Political Science 9: 355–384.
   Web of Science ®Google Scholar
• Leckie, George, et al. 2020. “Variance Partitioning in Multilevel Models for Count Data.” Accessed July 1, 2021. https://arxiv.org/abs/1911.06888.
   Google Scholar
• Lijphart, Arend. 2012. Patterns of Democracy: Government Forms and Performance in Thirty-six Countries - Second Edition. London: Yale University Press.
   Google Scholar
• Martin, Elizabeth A., Michael W. Traugott, and Courtney Kennedy. 2005. “A Review and Proposal for a New Measure of Poll Accuracy.” Public Opinion Quarterly 69: 342–269.
   Web of Science ®Google Scholar
• McAllister, Ian. 2002. “Calculating or Capricious? The New Politics of Late Deciding Voters.” In Do Political Campaigns Matter?, edited by David Farrell and Rüdiger Schmitt-Beck, 22–40. London: Routledge.
   Google Scholar
• McNeish, Daniel. 2016. “Estimation Methods for Mixed Logistic Models with few Clusters.” Multivariate Behavioral Research 51: 790–804.
   PubMed Web of Science ®Google Scholar
• Mellon, Jonathan, and Christopher Prosser. 2017. “Missing Nonvoters and Misweighted Samples: Explaining the 2015 Great British Polling Miss.” Public Opinion Quarterly 8: 661–687.
   Google Scholar
• Mitofsky, Warren. 1998. “Was 1996 a Worse Year for Polls Than 1948?” The Public Opinion Quarterly 62: 230–249.
   Web of Science ®Google Scholar
• Moon, Nick. 1999. Opinion Polls: History, Theory and Practice. Manchester: Manchester University Press.
   Google Scholar
• Mosteller, Frederick, et al. 1949. The Pre-Election Polls of 1948: Report to the Committee on Analysis of Pre-Election Polls and Forecasts. New York: Social Science Research Council.
   Google Scholar
• Nakagawa, Shinichi, Paul C. D. Johnson, and Holger Schielzeth. 2017. “The Coefficient of Determination R2 and Intra-Class Correlation Coefficient from Generalized Linear Mixed-Effects Models Revisited and Expanded.” Journal of the Royal Society Interface 14: 134.
   Web of Science ®Google Scholar
• Nakagawa, Shinichi, and Holger Schielzeth. 2010. “Repeatability for Gaussian and non-Gaussian Data: A Practical Guide for Biologists.” Biological Reviews of the Cambridge Philosophical Society 85: 935–956.
   PubMed Web of Science ®Google Scholar
• Osborne, Jason. 2000. “Advantages of Hierarchical Linear Modeling.” Practical Assessment Research Evaluation 7: 1–4.
   Google Scholar
• Owen, Art. 2013. “Monte Carlo Theory, Methods and Examples.” Accessed September 10, 2019. https://statweb.stanford.edu/~owen/mc/Ch-quadrature.pdf.
   Google Scholar
• Pickup, Mark, J. Scott Matthews, Will Jennings, Robert Ford, and Stephen D. Fisher. 2011. “Why did the Polls Overestimate Liberal Democrat Support? Sources of Polling Error in the 2010 British General Election.” Journal of Elections, Public Opinion and Parties 21: 179–209.
   Google Scholar
• Prosser, Christopher, and Jonathan Mellon. 2018. “The Twilight of the Polls? A Review of Trends in Polling Accuracy and the Causes of Polling Misses.” Government and Opposition 53: 757–790.
   Web of Science ®Google Scholar
• Raykov, Tenko. 2011. “Intraclass Correlation Coefficients in Hierarchical Designs: Evaluation Using Latent Variable Modelling.” Structural Equation Modelling 18: 73–90.
   Web of Science ®Google Scholar
• Robinson, Claude E. 1932. Straw Votes: A Study of Political Prediction. New York: Columbia University Press.
   Google Scholar
• Sanders, David. 2003. “Pre-election Polling in Britain, 1950–1997.” Electoral Studies 22: 1–20.
   Web of Science ®Google Scholar
• Shah, Paru, and Robert S. Smith. 2021. “Legacies of Segregation and Disenfranchisement: The Road from Plessy to Frank and Voter ID Laws in the United States.” RSF: The Russell Sage Foundation Journal of the Social Sciences 7: 134–146.
   Google Scholar
• Shieh, Gwowen. 2012. “A Comparison of Two Indices for the Intraclass Correlation Coefficient.” Behavioral Research Methods 44: 1212–1223.
   PubMed Web of Science ®Google Scholar
• Shugart, Matthew Soberg. 2008. “Inherent and Contingent Factors in Reform Initiation in Plurality Systems.” In To Keep or to Change First Past the Post?, edited by André Blais, 7–61. New York: Oxford University Press.
   Google Scholar
• Shugart, Matthew Soberg, and Reign Taagepera. 1989. Seats and Votes. New Haven: Yale University Press.
   Google Scholar
• Sohlberg, Jacob, and J. Alexander Branham. 2020. “Just a Difficult Election to Poll? How Context Affects Polling Accuracy.” Survey Methods: Insights from the Field (SMIF). Accessed 2 March, 2020. https://surveyinsights.org/?p=13652.
   Google Scholar
• Sommet, Nicolas, and Davide Morselli. 2017. “Keep Calm and Learn Multilevel Logistic Modeling: A Simplified Three-Step Procedure Using Stata, R, Mplus, and SPSS.” International Review of Social Psychology 30: 203–218.
   Web of Science ®Google Scholar
• Sturgis, Patrick, Nick Baker, Mario Callegaro, Stephen Fisher, Green Green, Will Jennings, Joni Kuha, Ben Lauderdale, and Patten Smith. 2016. Report of the Inquiry Into the 2015 British General Election Opinion Polls. London, England: Market Research Society and British Polling Council.
   Google Scholar
• Sturgis, Patrick, and Will Jennings. 2017. “Who Will Turnout and Who Will Not? The Indicator that Could Make or Break GE2017 Poll Predictions.” Accessed February 17, 2021. http://eprints.lse.ac.uk/80345/1/blogs.lse.ac.uk-Who%20will%20turnout%20and%20who%20will%20not%20The%20indicator%20that%20could%20make%20or%20break%20GE2017%20poll%20predictions.pdf.
   Google Scholar
• Tilley, James. 2002. “Political Generations and Partisanship in the UK, 1964–1997.” Journal of the Royal Statistical Society: Series A (Statistics in Society) 165: 121–135.
   Web of Science ®Google Scholar
• Tilley, James, and Geoffrey Evans. 2017. “The new Politics of Class After the 2017 General Election.” Political Quarterly 88 (4): 693–697.
   Web of Science ®Google Scholar
• Traugott, Michael W., and Clyde Tucker. 1984. “Strategies for Predicting Whether a Citizen Will Vote and Estimation of Electoral Outcomes.” Public Opinion Quarterly 48 (1): 330–343.
   Google Scholar
• Tudor, Jack. 2017. “Are Certain Elections More Predictable than Others? A Series of Bivariate Analyses of the Impact of Electoral Characteristics Upon the Predictability of British National Elections from 1945 to 2017.” Accessed June 25, 2020. SSRN: https://ssrn.com/abstract=3601958.
   Google Scholar
• Vavreck, Lynn. 2009. The Message Matters: The Economy and Presidential Campaigns. Princeton: Princeton University Press.
   Google Scholar
• Weisberg, Herbert F. 2009. The Total Survey Error Approach: A Guide to the new Science of Survey Research. Chicago: University of Chicago Press.
   Google Scholar
• Wilks-Heeg, Stuart, and Peter Anderson. 2020. “The Only (Other) Poll That Matters? Exit Polls and Election Night Forecasts in BBC General Election Results Broadcasts, 1955–2017.” Political Studies 0: 1–21. Accessed February 17, 2021. https://journals.sagepub.com/doi/full/10.1177/0032321720906324.
   Google Scholar
• Wlezien, Christopher, and Robert Erikson. 2001. “Campaign Effects in Theory and Practice.” American Politics Research 29: 419–436.
   Web of Science ®Google Scholar
• YouGov. 2019. “Final 2019 General Election MRP Model: Small Conservative Majority Likely.” Accessed December 23, 2020. https://yougov.co.uk/topics/politics/articles-reports/2019/12/10/final-2019-general-election-mrp-model-small-
   Google Scholar