Multiple outcome interactions in healthcare systems: a participatory outcome mapping approach

References

• Ackoff, R. L. 1994. “Systems Thinking and Thinking Systems.” System Dynamics Review 10 (2–-3): 175–188. doi:https://doi.org/10.1002/sdr.4260100206.
   Web of Science ®Google Scholar
• Akinluyi, E. A., K. Ison, and P. J. Clarkson. 2019. “Mapping Outcomes in Quality Improvement and System Design Activities: The Outcome Identification Loop and System Impact Model.” BMJ Open Quality 8 (3): e000439. doi:https://doi.org/10.1136/bmjoq-2018-000439.
   PubMedGoogle Scholar
• Arksey, Hilary, and Lisa O’Malley. 2005. “Scoping Studies: Towards a Methodological Framework.” International Journal of Social Research Methodology 8 (1): 19–32. doi:https://doi.org/10.1080/1364557032000119616.
   Google Scholar
• Baldeh, Tejan, Zuleika Saz-Parkinson, Paola Muti, Nancy Santesso, Gian Paolo Morgano, Wojtek Wiercioch, Robby Nieuwlaat, Axel Gräwingholt, Mireille Broeders, Stephen Duffy, Solveig Hofvind, Lennarth Nystrom, Lydia Ioannidou-Mouzaka, Sue Warman, Helen McGarrigle, Susan Knox, Patricia Fitzpatrick, Paolo Giorgi Rossi, Cecily Quinn, Bettina Borisch, Annette Lebeau, Chris de Wolf, Miranda Langendam, Thomas Piggott, Livia Giordano, Cary van Landsveld-Verhoeven, Jacques Bernier, Peter Rabe, and Holger J. Schünemann. 2020. “Development and Use of Health Outcome Descriptors: A Guideline Development Case Study.” Health and Quality of Life Outcomes 18 (1): 167. doi:https://doi.org/10.1186/s12955-020-01338-8.
   PubMed Web of Science ®Google Scholar
• Bastian, M., S. Heymann, and M. Jacomy. 2009. “Gephi: An Open Source Software for Exploring and Manipulating Networks.” Third International AAAI Conference on Weblogs and Social Media, San Jose, California (17-20 May). 361–362. doi:https://doi.org/10.1136/qshc.2004.010033.
   Google Scholar
• Benhiba, L., A. Loutfi, and M. A. J. Idrissi. 2017. “A Classification of Healthcare Social Network Analysis Applications.” HEALTHINF 2017 – 10th International Conference on Health Informatics, Proceedings; Part of 10th International Joint Conference on Biomedical Engineering Systems and Technologies, BIOSTEC, 5: 147–158. doi:https://doi.org/10.5220/0006168001470158.
   Google Scholar
• Black, N., L. Burke, C. B. Forrest, U. H. Ravens Sieberer, S. Ahmed, J. M. Valderas, S. J. Bartlett, and J. Alonso. 2016. “ Patient-Reported Outcomes: Pathways to Better Health, Better Services, and Better Societies.” Quality of life Research 25 (5): 1103–1112. doi:https://doi.org/10.1007/s11136-015-1168-3.
   PubMed Web of Science ®Google Scholar
• Blessing, L. T. M., and A. Chakrabarti. 2009. “DRM, a Design Research Methodology”. Vol. 1. London: Springer. doi:https://doi.org/10.1007/978-1-84882-587-1.
   Google Scholar
• Bombard, Y., G. R. Baker, E. Orlando, C. Fancott, P. Bhatia, S. Casalino, K. Onate, J.-L. Denis, and M.-P. Pomey. 2018. “Engaging Patients to Improve Quality of Care: A Systematic Review.” Implementation Science 13 (1): 98. doi:https://doi.org/10.1186/s13012-018-0784-z.
   PubMed Web of Science ®Google Scholar
• Braithwaite, J., K. Churruca, J. C. Long, L. A. Ellis, and J. Herkes. 2018. “When Complexity Science Meets Implementation Science: A Theoretical and Empirical Analysis of Systems Change.” BMC Medicine 16 (1): 63. doi:https://doi.org/10.1186/s12916-018-1057-z.
   PubMed Web of Science ®Google Scholar
• Buckley, C. A., and M. J. Waring. 2013. “Using Diagrams to Support the Research Process: Examples from Grounded Theory.” Qualitative Research 13 (2): 148–172. doi:https://doi.org/10.1177/1468794112472280.
   Web of Science ®Google Scholar
• Burns, C. M., A. M. Bisantz, and E. M. Roth. 2004. “Lessons from a Comparison of Work Domain Models: Representational Choices and Their Implications.” Human Factors 46 (4): 711–727. doi:https://doi.org/10.1518/hfes.46.4.711.56810.
   PubMed Web of Science ®Google Scholar
• Carayon, P., A. Schoofs Hundt, B. T. Karsh, A. P. Gurses, C. J. Alvarado, M. Smith, and P. F. Brennan. 2006. “Work System Design for Patient Safety: The SEIPS Model.”. Quality and Safety in Health Care 15, (SUPPL. 1): 50–58. doi:https://doi.org/10.1136/qshc.2005.015842.
   Google Scholar
• Carayon, Pascale, A. Wooldridge, P. Hoonakker, A. S. Hundt, and M. M. Kelly. 2020. “SEIPS 3.0: Human-Centered Design of the Patient Journey for Patient Safety.” Applied Ergonomics 84: 103033. doi:https://doi.org/10.1016/j.apergo.2019.103033.
   PubMed Web of Science ®Google Scholar
• Comi, A., N. Bischof, and M. J. Eppler. 2014. “Beyond Projection: Using Collaborative Visualization to Conduct Qualitative Interviews.” Qualitative Research in Organizations and Management 9 (2): 110–133. doi:https://doi.org/10.1108/QROM-05-2012-1074.
   Google Scholar
• Crilly, N., A. F. Blackwell, and P. J. Clarkson. 2006. “Graphic Elicitation: Using Research Diagrams as Interview Stimuli.” Qualitative Research 6 (3): 341–366. doi:https://doi.org/10.1177/1468794106065007.
   Google Scholar
• Davies, H. T. O., and I. K. Crombie. 1997. “Interpreting Health Outcomes.” Journal of Evaluation in Clinical Practice 3 (3): 187–199. doi:https://doi.org/10.1046/j.1365-2753.1997.00003.x.
   PubMedGoogle Scholar
• Dooris, M., A. Farrier, and L. Froggett. 2018. “Wellbeing: The Challenge of ‘Operationalising’ an Holistic Concept within a Reductionist Public Health Programme.” Perspectives in Public Health 138, (2): 93–99. doi:https://doi.org/10.1177/1757913917711204.
   PubMed Web of Science ®Google Scholar
• Earl, S., F. Carden, and T. Smutylo. 2001. Outcome Mapping. IDRC. Ottawa.
   Google Scholar
• Eden, C. 1994. “Cognitive Mapping and Problem Structuring for System Dynamics Model Building.” System Dynamics Review 10 (2–3): 257–276. doi:https://doi.org/10.1002/sdr.4260100212.
   Web of Science ®Google Scholar
• Elo, S., and H. Kyngäs. 2008. “The Qualitative Content Analysis Process.” Journal of Advanced Nursing 62 (1): 107–115. doi:https://doi.org/10.1111/j.1365-2648.2007.04569.x.
   PubMed Web of Science ®Google Scholar
• Flemming, K., A. Booth, R. Garside, Ö. Tunçalp, and J. Noyes. 2019. “Qualitative Evidence Synthesis for Complex Interventions and Guideline Development: Clarification of the Purpose, Designs and Relevant Methods.” BMJ Global Health 4 (Suppl 1): e000882. doi:https://doi.org/10.1136/bmjgh-2018-000882.
   PubMed Web of Science ®Google Scholar
• Freebairn, L., L. Rychetnik, J. A. Atkinson, P. Kelly, G. McDonnell, N. Roberts, C. Whittall, and S. Redman. 2017. “Knowledge Mobilisation for Policy Development: Implementing Systems Approaches through Participatory Dynamic Simulation Modelling.” Health Research Policy and Systems 15 (1): 83. doi:https://doi.org/10.1186/s12961-017-0245-1.
   PubMedGoogle Scholar
• Gear, C., E. Eppel, and J. Koziol-Mclain. 2018. “Utilizing Complexity Theory to Explore Sustainable Responses to Intimate Partner Violence in Health Care.” Public Management Review 20 (7): 1052–1067. doi:https://doi.org/10.1080/14719037.2017.1364407.
   Web of Science ®Google Scholar
• Greenhalgh, J. 2009. “The Applications of PROs in Clinical Practice: What Are They, Do They Work, and Why??” Quality of life Research18 (1): 115–123. doi:https://doi.org/10.1007/s11136-008-9430-6.
   PubMed Web of Science ®Google Scholar
• Guyatt, G. H., A. D. Oxman, R. Kunz, D. Atkins, J. Brozek, G. Vist, P. Alderson, P. Glasziou, Y. Falck-Ytter, and H. J. Schünemann. 2011. “GRADE Guidelines: 2. Framing the Question and Deciding on Important Outcomes.” Journal of Clinical Epidemiology 64 (4): 395–400. doi:https://doi.org/10.1016/j.jclinepi.2010.09.012.
   PubMed Web of Science ®Google Scholar
• Haskins Lisle, A., C. Merenda, and J. Gabbard. 2020. “Using Affinity Diagramming to Generate a Codebook: A Case Study on Young Military Veterans and Community Reintegration.” Qualitative Research 20 (4): 396–413. doi:https://doi.org/10.1177/1468794119851324.
   Web of Science ®Google Scholar
• Havlin, S., D. Y. Kenett, E. Ben-Jacob, A. Bunde, R. Cohen, H. Hermann, J. W. Kantelhardt, J. Kertész, S. Kirkpatrick, J. Kurths, J. Portugali, and S. Solomon. 2012. “Challenges in Network Science: Applications to Infrastructures, Climate, Social Systems and Economics.” European Physical Journal Special Topics 214 (1): 273–293. doi:https://doi.org/10.1140/epjst/e2012-01695-x.
   Web of Science ®Google Scholar
• Heneghan, C., B. Goldacre, and K. R. Mahtani. 2017. “Why Clinical Trial Outcomes Fail to Translate into Benefits for Patients.”. Trials 18, (1): 122. doi:https://doi.org/10.1186/s13063-017-1870-2.
   PubMed Web of Science ®Google Scholar
• Holden, R. J., P. Carayon, A. P. Gurses, P. Hoonakker, A. S. Hundt, A. A. Ozok, and A. J. Rivera-Rodriguez. 2013. “SEIPS 2.0: A Human Factors Framework for Studying and Improving the Work of Healthcare Professionals and Patients.” Ergonomics 56 (11): 1669–1686. doi:https://doi.org/10.1080/00140139.2013.838643.
   PubMed Web of Science ®Google Scholar
• Hughes, H. P. N., C. W. Clegg, L. E. Bolton, and L. C. Machon. 2017. “Systems Scenarios: A Tool for Facilitating the Socio-Technical Design of Work Systems.” Ergonomics 60 (10): 1319–1335. doi:https://doi.org/10.1080/00140139.2017.1288272.
   PubMed Web of Science ®Google Scholar
• Jacomy, M., T. Venturini, S. Heymann, and M. Bastian. 2014. “ForceAtlas2, a Continuous Graph Layout Algorithm for Handy Network Visualization Designed for the Gephi Software.” PLOS One 9 (6): e98679. doi:https://doi.org/10.1371/journal.pone.0098679.
   PubMed Web of Science ®Google Scholar
• Jones P. H. 2014. “Systemic Design Principles for Complex Social Systems.” In Social Systems and Design. Translational Systems Sciences, edited by G. Metcalf, vol 1. Tokyo: Springer. doi:https://doi.org/10.1007/978-4-431-54478-4_4.
   Google Scholar
• Jones, P., and J. Bowes. 2017. “Rendering Systems Visible for Design: Synthesis Maps as Constructivist Design Narratives.” She Ji: The Journal of Design, Economics, and Innovation 3 (3): 229–248. doi:https://doi.org/10.1016/j.sheji.2017.12.001.
   Google Scholar
• Jun, S., M. Kim, and J. Lee. 2011. “The System Diagrams: Shifting Perspectives.” Design Issues 27 (2): 72–89. doi:https://doi.org/10.1162/DESI_a_00078-Jun.
   Web of Science ®Google Scholar
• Khan, S., A. Vandermorris, J. Shepherd, J. W. Begun, H. J. Lanham, M. Uhl-Bien, and W. Berta. 2018. “Embracing Uncertainty, Managing Complexity: Applying Complexity Thinking Principles to Transformation Efforts in Healthcare Systems.”BMC Health Services Research 18, (1): 192. doi:https://doi.org/10.1186/s12913-018-2994-0.
   PubMedGoogle Scholar
• Kohler, K., and A. Ercole. 2020. “Can Network Science Reveal Structure in a Complex Healthcare System? A Network Analysis Using Data from Emergency Surgical Services.” BMJ Open 10 (2): e034265. doi:https://doi.org/10.1136/bmjopen-2019-034265.
   PubMed Web of Science ®Google Scholar
• La Placa, V., A. McNaught, and A. Knight. 2013. “Discourse on Wellbeing in Research and Practice.” International Journal of Wellbeing 3 (1): 116–125. doi:https://doi.org/10.5502/ijw.v3i1.7.
   Google Scholar
• Landa-Avila, I. C., C. Escobar-Tello, G. T. Jun, and R. Cain. 2020. “A Holistic Outcome-Based Approach to Co-Create Healthcare Systems.” In DRS 2020 International Conference: Sinergy, edited by S. Boess, M. Cheung, & R. Cain, 1366–1391. Brisbane, Australia: Design Research Society. doi:https://doi.org/10.21606/drs.2020.127.
   Google Scholar
• Landa-Avila, I. C., G. T. Jun, R. Cain, and M. C. Escobar Tello. 2018. “Holistic Outcome-Based Visualisations for Defining the Purpose of Healthcare System.” In Relating System Thinking and Design (RSD7) 2018 Symposium, edited by S. Barbero, 300–314. Turin, Italy: Systemic Design Association.
   Google Scholar
• Lewis, G., and H. Killaspy. 2014. “Getting the Measure of Outcomes in Clinical Practice.” Advances in Psychiatric Treatment 20 (3): 165–171. doi:https://doi.org/10.1192/apt.bp.113.011809.
   Google Scholar
• Li, W., J. Y. Yang, and W. C. Hadden. 2009. “Analyzing Complex Networks from a Data Analysis Viewpoint.”. Europhysics Letters 88, (6): 68007. doi:https://doi.org/10.1209/0295-5075/88/68007.
   Google Scholar
• Lowe, T. 2013. “New Development: The Paradox of Outcomes—the More we Measure, the Less we Understand.” Public Money & Management 33 (3): 213–216. doi:https://doi.org/10.1080/09540962.2013.785707.
   Web of Science ®Google Scholar
• McConachie, H., N. Livingstone, C. Morris, B. Beresford, A. Le Couteur, P. Gringras, D. Garland, G. Jones, G. Macdonald, K. Williams, and J. R. Parr. 2018. “Parents Suggest Which Indicators of Progress and Outcomes Should be Measured in Young Children with Autism Spectrum Disorder.” Journal of Autism and Developmental Disorders 48 (4): 1041–1051. doi:https://doi.org/10.1007/s10803-017-3282-2.
   PubMed Web of Science ®Google Scholar
• Moggridge, B. 2007. Designing Interactions. Cambridge: MIT Press. https://ellieharmon.com/wp-content/uploads/01-21-Moggridge-People.pdf.pdf
   Google Scholar
• Naikar, N. 2017. “Cognitive Work Analysis: An Influential Legacy Extending beyond Human Factors and Engineering.” Applied Ergonomics 59 (Pt B): 528–540. doi:https://doi.org/10.1016/j.apergo.2016.06.001.
   PubMed Web of Science ®Google Scholar
• Naikar, N., R. Hopcroft, and A. Moylan. 2005. Work Domain Analysis: Theoretical Concepts and Methodology. Defence Science and Technology Report, 104. https://apps.dtic.mil/dtic/tr/fulltext/u2/a449707.pdf
   Google Scholar
• Newman, M. E. J. 2003. “The Structure and Function of Complex Networks.” SIAM Review 45 (2): 167–256. doi:https://doi.org/10.1137/S003614450342480.
   Web of Science ®Google Scholar
• Paina, L., and D. H. Peters. 2012. “Understanding Pathways for Scaling up Health Services through the Lens of Complex Adaptive Systems.” Health Policy and Planning 27 (5): 365–373. doi:https://doi.org/10.1093/heapol/czr054.
   PubMed Web of Science ®Google Scholar
• Paterson, C., C. Baarts, L. Launsø, and M. J. Verhoef. 2009. “Evaluating Complex Health Interventions: A Critical Analysis of the “‘Ooutcomes’ Concept”.” BMC Complementary and Alternative Medicine 9 (1): 18. doi:https://doi.org/10.1186/1472-6882-9-18.
   PubMedGoogle Scholar
• Paz-Ybarnegaray, R., and B. Douthwaite. 2017. “Outcome Evidencing: A Method for Enabling and Evaluating Program Intervention in Complex Systems.” American Journal of Evaluation 38 (2): 275–293. doi:https://doi.org/10.1177/1098214016676573.
   Web of Science ®Google Scholar
• Peters, D. H. 2014. “The Application of Systems Thinking in Health: Why Use Systems Thinking??” Health Research Policy and Systems 12 (1): 51. doi:https://doi.org/10.1186/1478-4505-12-51.
   PubMedGoogle Scholar
• Petticrew, M., C. Knai, J. Thomas, E. A. Rehfuess, J. Noyes, A. Gerhardus, J. M. Grimshaw, H. Rutter, and E. McGill. 2019. “Implications of a Complexity Perspective for Systematic Reviews and Guideline Development in Health Decision Making.” BMJ Global Health 4 (Suppl 1): e000899. doi:https://doi.org/10.1136/bmjgh-2018-000899.
   PubMedGoogle Scholar
• Prell, C. 2012. Social Network Analysis. London: SAGE Publications Ltd.
   Google Scholar
• Rasmussen, J., A. M. Pejtersen, and L. P. Goodstein. 1994. Cognitive Systems Engineering. New York, USA: John Wiley Sons Inc. https://dl.acm.org/citation.cfm?id=179248
   Google Scholar
• Read, G. J. M., P. M. Salmon, N. Goode, and M. G. Lenné. 2018. “A Sociotechnical Design Toolkit for Bridging the Gap between Systems-Based Analyses and System Design.” Human Factors and Ergonomics in Manufacturing & Service Industries 28 (6): 327–341. doi:https://doi.org/10.1002/hfm.20769.
   Web of Science ®Google Scholar
• Read, G. J. M., P. M. Salmon, M. G. Lenné, and D. P. Jenkins. 2015. “Designing a Ticket to Ride with the Cognitive Work Analysis Design Toolkit.” Ergonomics 58 (8): 1266–1286. doi:https://doi.org/10.1080/00140139.2015.1013576.
   PubMed Web of Science ®Google Scholar
• Read, G. J. M., P. M. Salmon, M. G. Lenné, and N. A. Stanton. 2015. “Designing Sociotechnical Systems with Cognitive Work Analysis: Putting Theory Back into Practice.” Ergonomics 58 (5): 822–851. doi:https://doi.org/10.1080/00140139.2014.980335.
   PubMed Web of Science ®Google Scholar
• Reuben, D. B., and M. E. Tinetti. 2012. “Goal-Oriented Patient Care — An Alternative Health Outcomes Paradigm.” New England Journal of Medicine 366 (9): 777–779. doi:https://doi.org/10.1056/NEJMp1113631.
   PubMed Web of Science ®Google Scholar
• Sajtos, L., M. Kleinaltenkamp, and J. Harrison. 2018. “Boundary Objects for Institutional Work across Service Ecosystems.” Journal of Service Management 29 (4): 615–640. doi:https://doi.org/10.1108/JOSM-01-2017-0011.
   Web of Science ®Google Scholar
• Sevaldson, B. 2015. “Gigamaps: Their Role as Bridging Artefacts and a New Sense Sharing Model.” Proceedings of Relating Systems Thinking and Design (RSD4) 2015 Symposium, Banff, Canada, September 1–3, 2015, 1–11. https://app.box.com/s/tsj7ewtcy9dr63knf64tvo3yrepmzdov.
   Google Scholar
• Shannon-Baker, P., and C. Edwards. 2018. “The Affordances and Challenges to Incorporating Visual Methods in Mixed Methods Research.” American Behavioral Scientist 62 (7): 935–955. doi:https://doi.org/10.1177/0002764218772671.
   Web of Science ®Google Scholar
• Star, S. L. 2010. “This is Not a Boundary Object: Reflections on the Origin of a Concept.” Science, Technology, & Human Values 35 (5): 601–617. doi:https://doi.org/10.1177/0162243910377624.
   Web of Science ®Google Scholar
• Star, S. L., and J. R. Griesemer. 1989. “Institutional Ecology, ‘Translations’ and Boundary Objects: Amateurs and Professionals in Berkeley’s Museum of Vertebrate Zoology, 1907–39.” Social Studies of Science 19 (3): 387–420. doi:https://doi.org/10.1177/030631289019003001.
   Web of Science ®Google Scholar
• St-Maurice, J. D., and C. M. Burns. 2018. “Using Cognitive Work Analysis to Compare Complex System Domains.” Theoretical Issues in Ergonomics Science 19 (5): 553–577. doi:https://doi.org/10.1080/1463922X.2017.1406556.
   Web of Science ®Google Scholar
• Stork, D., and W. D. Richards. 1992. “Nonrespondents in Communication Network Studies.” Group & Organization Management 17 (2): 193–209. doi:https://doi.org/10.1177/1059601192172006.
   Google Scholar
• Taysom, E., and N. Crilly. 2017. “Resilience in Sociotechnical Systems: The Perspectives of Multiple Stakeholders.” She Ji: The Journal of Design, Economics, and Innovation 3 (3): 165–182. doi:https://doi.org/10.1016/j.sheji.2017.10.011.
   Google Scholar
• The Health Foundation. 2011. “Complex Adaptive Systems.” Procedia Computer Science 6: 1–32.
   Google Scholar
• Warwick-Giles, L., and K. Checkland. 2018. “Integrated Care: Using “Sensemaking” to Understand How Organisations Are Working Together to Transform Local Health and Social Care Services.” Journal of Health Organization and Management 32 (1): 85–100. doi:https://doi.org/10.1108/JHOM-03-2017-0057.
   PubMed Web of Science ®Google Scholar
• Wilkin, D., L. Hallam, and M.-A. Doggett. 1993. Measures of Need and Outcome for Primary Health Care. Oxford: Oxford University Press.
   Google Scholar
• Wilson-Grau, R., and H. Britt. 2012. “Outcome Harvesting.” Ford Foundation, May 25. www.fordfoundation.org
   Google Scholar
• Woolf, S., H. J. Schünemann, M. P. Eccles, J. M. Grimshaw, and P. Shekelle. 2012. “Developing Clinical Practice Guidelines: Types of Evidence and Outcomes; Values and Economics, Synthesis, Grading, and Presentation and Deriving Recommendations.” Implementation Science 7 (1): 61. doi:https://doi.org/10.1186/1748-5908-7-61.
   PubMedGoogle Scholar