Complex systems, explanation and policy: implications of the crisis of replication for public health research

References

• Aliaga, M., Cobb, G., Cuff, C., Garfield, J., Gould, R., Lock, R., … Witmer, J. (2010). Guidelines on assessment and instruction in statistics education: College report. American Statistical Association. Retrieved from http://www.amstat.org/education/gaise/GaiseCollege_Full.pdf
   Google Scholar
• Baker, M. (2016). 1,500 scientists lift the lid on reproducibility. Nature, 533, 452–454.10.1038/533452a
   PubMed Web of Science ®Google Scholar
• BBC. (2015, December 11). Today, Radio 4, Transcribed from online recording by RLG.
   Google Scholar
• Bonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012). Realist randomised controlled trials: A new approach to evaluating complex public health interventions. Social Science & Medicine, 75, 2299–2306.10.1016/j.socscimed.2012.08.032
   PubMed Web of Science ®Google Scholar
• Byrne, D. (1998). Complexity and the social sciences. Abingdon: Routledge.
   Google Scholar
• Campbell, N., Murray, E., Darbyshire, J., Emery, J., Farmer, A., Griffiths, F., … Kinmonth, A. L. (2007). Designing and evaluating complex interventions to improve health care. British Medical Journal, 334, 455–459.10.1136/bmj.39108.379965.BE
   PubMed Web of Science ®Google Scholar
• Cilliers, P. (2005). Complexity, deconstruction and relativism. Theory, Culture & Society, 22, 255–267.10.1177/0263276405058052
   Web of Science ®Google Scholar
• Colchero, M., Popkin, B., Rivera, J., & Ng, S. (2016). Beverage purchases from stores in Mexico under the excise tax on sugar sweetened beverages: Observational study. British Medical Journal, 352, h6704. doi:10.1136/bmj.h6704
   PubMed Web of Science ®Google Scholar
• Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008). Developing and evaluating complex interventions: The new Medical research council guidance. British Medical Journal, 337, 979–983.
   Web of Science ®Google Scholar
• Denzin, N. K., & Lincoln, Y. S. (2005). The SAGE handbook of qualitative research (4th ed.). London: Sage.
   Google Scholar
• Donaldson, S. (2007). Program theory-driven evaluation science: Strategies and applications. Mahwah, NJ: Erlbaum.
   Google Scholar
• Gelman, A., & Loken, E. (2013) The garden of forking paths: Why multiple comparisons can be a problem, even when there is no ‘fishing expedition’ or ‘p-hacking’ and the research hypothesis was posited ahead of time. Unpublished manuscript. Retrieved from http://www.stat.columbia.edu/~gelman/research/unpublished/p_hacking.pdf
   Google Scholar
• Gigerenzer, G. (2002). Adaptive thinking: Rationality in the real world. Oxford: Oxford University Press.10.1093/acprof:oso/9780195153729.001.0001
   Google Scholar
• Green, J., Roberts, H., Petticrew, M., Steinbach, R., Goodman, A., Jones, A., & Edwards, P. (2015). Integrating quasi-experimental and inductive designs in evaluation: A case study of the impact of free bus travel on public health. Evaluation, 21, 391–406.10.1177/1356389015605205
   Web of Science ®Google Scholar
• Greenwood-Lee, J., Hawe, P., Nettel-Aguirre, A., Shiell, A., & Marshall, D. A. (2016). Complex intervention modelling should capture the dynamics of adaptation. BMC Medical Research Methodology, 16, 51.
   PubMed Web of Science ®Google Scholar
• Harvey, D. L., & Reed, M. (1996). Social science as the study of complex systems. In D. L. Kiel & E. Elliot (Eds.), Chaos theory in the social sciences: Foundations and applications (pp. 295–323). Ann Arbor: The University of Michigan Press.
   Google Scholar
• Hood, R. (2014). Complexity and integrated working in children’s services. British Journal of Social Work, 44, 27–43.10.1093/bjsw/bcs091
   Web of Science ®Google Scholar
• Ipsos MORI. (2016). The Ipsos MORI veracity index 2015: Trust in professions. Retrieved from https://www.ipsos-mori.com/researchpublications/researcharchive/3685/Politicians-are-still-trusted-less-than-estate-agents-journalists-and-bankers.aspx
   Google Scholar
• Leamer, E. E. (1983). Let’s take the con out of econometrics. American Economic Review, 73, 31–43.
   Web of Science ®Google Scholar
• Lewin, S., Glenton, C., & Oxman, A. D. (2009). Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: Methodological study. British Medical Journal, 339, b3496. doi:10.1136/bmj.b3496
   PubMed Web of Science ®Google Scholar
• Lipton, P. (2004). Inference to the best explanation (2nd ed.). Abingdon: Routledge.
   Google Scholar
• Manski, C. (2013). Public policy in an uncertain world: Analysis and decisions. Boston, MA: Harvard University Press.
   Google Scholar
• Mayo, D. G., & Cox, D. R. (2006). Frequentist statistics as a theory of inductive inference. Institute of Mathematical Statistics Lecture Notes – Monograph Series, 49, 77–97.10.1214/074921706000000400
   Google Scholar
• Moore, G. F., Audrey, S., Barker, S., Bond, L., Bonell, C., Hardeman, W., & Baird, J. (2015). Process evaluation of complex interventions: Medical research council guidance. British Medical Journal, 350, h1258. doi:10.1136/bmj.h1258
   PubMed Web of Science ®Google Scholar
• Murray, E., Treweek, S., Pope, C., MacFarlane, A., Ballini, L., Dowrick, C., & May, C. (2010). Normalisation process theory: A framework for developing, evaluating and implementing complex interventions. BMC Medicine, 8, 63. doi:10.1186/1741-7015-8-63
   PubMed Web of Science ®Google Scholar
• Pawson, R. (2013). The science of evaluation: A realist manifesto. London: Sage.10.4135/9781473913820
   Google Scholar
• Platt, J. (1964). Strong inference. Science, 146, 347–353.10.1126/science.146.3642.347
   PubMed Web of Science ®Google Scholar
• Sayer, A. (1992). Realism and social science. London: Sage.
   Google Scholar
• Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allow presenting anything as significant. Psychological Science, 22, 1359–1366.10.1177/0956797611417632
   PubMed Web of Science ®Google Scholar
• Stacey, R. D. (2007). Strategic management and organisational dynamics: The challenge of complexity to ways of thinking about organisations (5th ed.). Harlow: Pearson.
   Google Scholar
• Thompson, D. S., Fazio, X., Kustra, E., Patrick, L., & Stanley, D. (2016). Scoping review of complexity theory in health services research. BMC Health Services Research, 16, 87.10.1186/s12913-016-1343-4
   PubMed Web of Science ®Google Scholar
• Wight, D., Wimbush, E., Jepson, R., & Doi, L. (2015). Six steps in quality intervention development (6SQuID). Journal of Epidemiology and Community Health. doi:10.1136/jech-2015-205952
   PubMed Web of Science ®Google Scholar