Evaluating a complex health promotion intervention: case application of three systems methods

References

• Bastian, M., Heymann, S., & Jacomy, M. (2009). Gephi: An open source software for exploring and manipulating networks. ICWSM, 8, 361–362.
   Google Scholar
• Beer, S. (1985). Diagnosing the system for organizations. New York, NY: Wiley.
   Google Scholar
• BeLue, R., Carmack, C., Myers, K. R., Weinreb-Welch, L., & Lengerich, E. J. (2012). Systems thinking tools as applied to community-based participatory research: A case study. Health Education & Behavior, 39(6), 745–751.10.1177/1090198111430708
   PubMed Web of Science ®Google Scholar
• Best, A., & Holmes, B. (2010). Systems thinking, knowledge and action: Towards better models and methods. Evidence & Policy: A Journal of Research, Debate and Practice, 6(2), 145–159.10.1332/174426410X502284
   Google Scholar
• Brown, P., & Zavestoski, S. (2004). Social movements in health: An introduction. Sociology of Health & Illness, 26, 679–694.10.1111/shil.2004.26.issue-6
   PubMed Web of Science ®Google Scholar
• Carey, G., Malbon, E., Carey, N., Joyce, A., Crammond, B., & Carey, A. (2015). Systems science and systems thinking for public health: A systematic review of the field. British Medical Journal Open, 5, e009002.
   PubMed Web of Science ®Google Scholar
• Chatterji, M. (2016). Causal inferences in the effectiveness of complex social programs: Navigating assumptions, sources of complexity and evaluation design challenges. Evaluation and Program Planning, 59, 128–140.10.1016/j.evalprogplan.2016.05.009
   PubMed Web of Science ®Google Scholar
• Damon, W. (2004). What is positive youth development? AAPS, 591, 13–24.
   Google Scholar
• Eoyang, G. H., & Berkas, T. H. (1998). Evaluation in a complex adaptive system. In M. Lissack & H. Gunz (Eds.), Managing complexity in organizations (pp. 313–335). Westport, CT: Quorum Books.
   Google Scholar
• Foster-Fishman, P., Nowell, B., & Yang, H. (2007). Putting the system back into systems change: A framework for understanding and changing organizational and community systems. American Journal of Community Psychology, 39, 197–215.10.1007/s10464-007-9109-0
   PubMed Web of Science ®Google Scholar
• Gates, E. F. (2016). Making sense of the emerging conversation in evaluation about systems thinking and complexity science. Evaluation and Program Planning, 59, 62–73.10.1016/j.evalprogplan.2016.08.004
   PubMed Web of Science ®Google Scholar
• Gatrell, A. C. (2005). Complexity theory and geographies of health: A critical assessment. Social Science & Medicine, 60(12), 2661–2671.10.1016/j.socscimed.2004.11.002
   PubMed Web of Science ®Google Scholar
• Green, L. W. (2006). Public health asks of systems science: To advance our evidence-based practice, can you help us get more practice-based evidence? American Journal of Public Health, 96(3), 406–409.10.2105/AJPH.2005.066035
   PubMed Web of Science ®Google Scholar
• Hawe, P. (2015). Lessons from complex interventions to improve health. Annual Review of Public Health, 36, 307–323.10.1146/annurev-publhealth-031912-114421
   PubMed Web of Science ®Google Scholar
• Hawe, P., Shiell, A., & Riley, T. (2009). Theorising interventions as events in systems. American Journal of Community Psychology, 43(3–4), 267–276.10.1007/s10464-009-9229-9
   PubMed Web of Science ®Google Scholar
• Hirsch, G. B., Levine, R., & Miller, R. L. (2007). Using system dynamics modeling to understand the impact of social change initiatives. American Journal of Community Psychology, 39(3–4), 239–253.10.1007/s10464-007-9114-3
   PubMed Web of Science ®Google Scholar
• Hovmand, P. S. (2014). Community based system dynamics. New York, NY: Springer.10.1007/978-1-4614-8763-0
   Google Scholar
• Jayasinghe, S. (2011). Conceptualising population health: From mechanistic thinking to complexity science. Emerging Themes in Epidemiology, 8(1), 2.10.1186/1742-7622-8-2
   PubMedGoogle Scholar
• Judge, K., & Bauld, L. (2001). Strong theory, flexible methods: Evaluating complex community-based initiatives. Critical Public Health, 11(1), 19–38.10.1080/09581590010028237
   Google Scholar
• Leischow, S. J., & Milstein, B. (2006). Systems thinking and modeling for public health practice. American Journal of Public Health, 96(3), 403–405.10.2105/AJPH.2005.082842
   PubMed Web of Science ®Google Scholar
• Luna-Reyes, L. F., & Andersen, D. L. (2003). Collecting and analyzing qualitative data for system dynamics: Methods and models. System Dynamics Review, 19(4), 271–296.10.1002/(ISSN)1099-1727
   Web of Science ®Google Scholar
• Marchal, B., Van Belle, S., De Brouwere, V., & Witter, S. (2013). Studying complex interventions: Reflections from the FEMHealth project on evaluating fee exemption policies in West Africa and Morocco. BMC Health Services Research, 13, 469.
   PubMed Web of Science ®Google Scholar
• Matheson, A., Dew, K., & Cumming, J. (2009). Complexity, evaluation and the effectiveness of community-based interventions to reduce health inequalities. Health Promotion Journal of Australia, 20(3), 221–226.10.1071/HE09221
   PubMed Web of Science ®Google Scholar
• Midgley, G. (2006). Systemic intervention for public health. American Journal of Public Health, 96(3), 466–472.10.2105/AJPH.2005.067660
   PubMed Web of Science ®Google Scholar
• Mowles, C. (2014). Complex, but not quite complex enough: The turn to the complexity sciences in evaluation scholarship. Evaluation, 20(2), 160–175.10.1177/1356389014527885
   Web of Science ®Google Scholar
• Norman, C. D. (2009). Health promotion as a systems science and practice. Journal of Evaluation in Clinical Practice, 15(5), 868–872.10.1111/jep.2009.15.issue-5
   PubMed Web of Science ®Google Scholar
• Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York, NY: Guilford.
   Google Scholar
• Plsek, P. E., & Greenhalgh, T. (2001). Complexity science: The challenge of complexity in health care. BMJ, 323(7313), 625–628.10.1136/bmj.323.7313.625
   PubMed Web of Science ®Google Scholar
• Resnick, M. D., Bearman, P. S., Blum, R. W., Bauman, K. E., Harris, K. M., Jones, J., … Ireland, M. (1997). Protecting adolescents from harm: Findings from the National Longitudinal Study on Adolescent Health. JAMA, 278(10), 823–832.10.1001/jama.1997.03550100049038
   PubMed Web of Science ®Google Scholar
• Resnicow, K., & Page, S. E. (2008). Embracing chaos and complexity: A quantum change for public health. American Journal of Public Health, 98(8), 1382–1389.10.2105/AJPH.2007.129460
   PubMed Web of Science ®Google Scholar
• Rogers, P. (2008). Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation, 14(1), 29–48.10.1177/1356389007084674
   Google Scholar
• Schwaninger, M. (2001). Intelligent organizations: An integrative framework. Systems Research and Behavioral Science, 18, 137–158.10.1002/sres.v18:2
   Web of Science ®Google Scholar
• Shiell, A., Hawe, P., & Gold, L. (2008). Complex interventions or complex systems? Implications for health economic evaluation. BMJ, 336(7656), 1281.
   PubMed Web of Science ®Google Scholar
• Snow, D., Soule, S., & Kriesi, H. (Eds.). (2008). The Blackwell companion to social movements. Malden, MA: Wiley.
   Google Scholar
• Sterman, J. D. (2006). Learning from evidence in a complex world. American Journal of Public Health, 96, 505–514.10.2105/AJPH.2005.066043
   PubMed Web of Science ®Google Scholar
• Tepe, S., & Haslett, T. (2002). Occupational health and safety systems corporate governance and viable systems diagnosis: An action research approach. Systemic Practice and Action Research, 15(6), 509–522.
   Web of Science ®Google Scholar
• Trochim, W. M., Cabrera, D. A., Milstein, B., Gallagher, R. S., & Leischow, S. J. (2006). Practical challenges of systems thinking and modeling in public health. American Journal of Public Health, 96(3), 538–546.10.2105/AJPH.2005.066001
   PubMed Web of Science ®Google Scholar
• Vennix, J. A. M. (1996). Group model-building. New York, NY: Wiley.
   Google Scholar
• Walton, M. (2014). Applying complexity theory: A review to inform evaluation design. Evaluation and Program Planning, 45, 119–126.10.1016/j.evalprogplan.2014.04.002
   PubMed Web of Science ®Google Scholar
• Williams, B., & Hummelbrunner, R. (2010). Systems concepts in action: A practitioner’s toolkit. Stanford, CA: Stanford University Press.
   Google Scholar