Advanced search
Publication Cover
Health Systems Volume 12, 2023 - Issue 4: Using Participatory Systems Approaches to Improve Healthcare Delivery
Submit an article Journal homepage
689
Views
0
CrossRef citations to date
0
Altmetric
Research Article

From digital health to learning health systems: four approaches to using data for digital health design

Valeria Pannunzioa Department of Design, Organization and Strategy, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, the NetherlandsCorrespondence[email protected]
ORCID Iconhttps://orcid.org/0000-0002-9074-4139View further author information
ORCID Icon,
Maaike Kleinsmanna Department of Design, Organization and Strategy, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, the NetherlandsORCID Iconhttps://orcid.org/0000-0003-4120-5048View further author information
ORCID Icon,
Dirk Sneldersa Department of Design, Organization and Strategy, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, the NetherlandsORCID Iconhttps://orcid.org/0000-0002-6678-9281View further author information
ORCID Icon &
Jeroen Raijmakersa Department of Design, Organization and Strategy, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, the Netherlands;b Philips Experience Design, Philips, Eindhoven, the NetherlandsORCID Iconhttps://orcid.org/0000-0002-0042-7472View further author information
ORCID Icon
Pages 481-494 | Received 16 Dec 2021, Accepted 14 Nov 2023, Published online: 13 Jan 2024

References

  • Abras, C., Maloney-Krichmar, D., & Preece, J. (2004). User-centered design. Bainbridge W Encyclopedia of Human-Computer Interaction, 37(4), 445–456.
  • Ackoff, R. L. (1989). From data to wisdom. Journal of Applied Systems Analysis, 16(1), 3–9.
  • Alwashmi, M. F., Hawboldt, J., Davis, E., & Fetters, M. D. (2019). The iterative convergent design for mobile health usability testing: Mixed methods approach. JMIR MHealth and UHealth, 7(4), e11656. https://doi.org/10.2196/11656
  • Archer, L. B. (1964). Design of hospital beds. British Medical Journal, 1(5394), 1383. https://doi.org/10.1136/bmj.1.5394.1383-a
  • Ash, J. S., Berg, M., & Coiera, E. (2004). Some unintended consequences of information technology in health care: The nature of patient care information system-related errors. Journal of the American Medical Informatics Association, 11(2), 104–112. https://doi.org/10.1197/jamia.m1471
  • Badke-Schaub, P., & Gehrlicher, A. (2003). Patterns of decisions in design: leaps, loops, cycles, sequences and meta-processes. In DS 31: Proceedings of ICED 03, the 14th International Conference on Engineering Design, Stockholm.
  • Bainbridge, L. (1983). Ironies of automation. Analysis, design and evaluation of man–machine systems (pp. 129–135). https://doi.org/10.1016/B978-0-08-029348-6.50026-9
  • Bastien, J. C. (2010). Usability testing: A review of some methodological and technical aspects of the method. International Journal of Medical Informatics, 79(4), e18–e23. https://doi.org/10.1016/j.ijmedinf.2008.12.004
  • Bellomo, R., Kellum, J. A., & Ronco, C. (2012). Acute kidney injury. The Lancet, 380(9843), 756–766. https://doi.org/10.1016/s0140-6736(11)61454-2
  • Berg, K., Doktorchik, C., Quan, H., & Saini, V. (2022). Automating data collection methods in electronic health record systems: A social determinant of health (SDOH) viewpoint. Health Systems, 1–9. https://doi.org/10.1080/20476965.2022.2075796
  • Birnbaum, F., Lewis, D. M., Rosen, R., & Ranney, M. L. (2015). Patient engagement and the design of digital health. Academic Emergency Medicine: Official Journal of the Society for Academic Emergency Medicine, 22(6), 754. https://doi.org/10.1111/acem.12692
  • Bogers, S., Frens, J., Van Kollenburg, J., Deckers, E., & Hummels, C. (2016). Connected baby bottle: A design case study towards a framework for data-enabled design. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (pp. 301–311). https://doi.org/10.1145/2901790.2901855
  • Bogers, S., Van Kollenburg, J., Deckers, E., Frens, J., & Hummels, C. (2018). A situated exploration of designing for personal health ecosystems through data-enabled design. In Proceedings of the 2018 Designing Interactive Systems Conference (pp. 109–120). https://doi.org/10.1145/3196709.3196769
  • Bogers, S., van Kollenburg, J., Frens, J., & Djajadiningrat, T. (2016). Data-enabled-design: A situated exploration of rich interactions. In Proceedings of the 2016 ACM Conference Companion Publication on Designing Interactive Systems (pp. 45–48). https://doi.org/10.1145/2908805.2913015
  • Bogers, S., Van Kollenburg, J., Rutjes, H., Deckers, E., Frens, J., & Hummels, C. (2018). A showcase of data-enabled design explorations. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–4). https://doi.org/10.1145/3170427.3186543
  • Bourdeaux, C., Ghosh, E., Atallah, L., Palanisamy, K., Patel, P., Thomas, M., Gould, T., Warburton, J., Rivers, J., & Hadfield, J. (2020). Impact of a computerized decision support tool deployed in two intensive care units on acute kidney injury progression and guideline compliance: A prospective observational study. Critical Care, 24(1), 1–11. https://doi.org/10.1186/s13054-020-03343-1
  • Briard, T., Jean, C., Aoussat, A., & Véron, P. (2023). Challenges for data-driven design in early physical product design: A scientific and industrial perspective. Computers in Industry, 145, 103814. https://doi.org/10.1016/j.compind.2022.103814
  • Budrionis, A., & Bellika, J. G. (2016). The learning healthcare system: Where are we now? A systematic review. Journal of Biomedical Informatics, 64, 87–92. https://doi.org/10.1016/j.jbi.2016.09.018
  • Cantamessa, M., Montagna, F., Altavilla, S., & Casagrande Seretti, A. (2020). Data-driven design: the new challenges of digitalization on product design and development. Design Science, 6, 6. https://doi.org/10.1017/dsj.2020.25
  • Chamberlain, P., & Craig, C. (2017). Design for health: Reflections from the editors. Design for Health, 1(1), 3–7. https://doi.org/10.1080/24735132.2017.1296273
  • Chang, A. Y., Cowling, K., Micah, A. E., Chapin, A., Chen, C. S., Ikilezi, G., Qorbani, M., Wu, J., Younker, T., Zhao, Y., Zlavog, B. S., Abbafati, C., Ahmed, A. E., Alam, K., Alipour, V., Aljunid, S. M., Almalki, M. J., Alvis-Guzman, N., Ammar, W., & Murray, C. J. L.… Sadat, N. (2019). Past, present, and future of global health financing: A review of development assistance, government, out-of-pocket, and other private spending on health for 195 countries, 1995–2050. The Lancet, 393(10187), 2233–2260. https://doi.org/10.1016/S0140-6736(19)30841-4
  • Ciccone, N. W., Patou, F., & Maier, A. M. (2019). Designing for better healthcare: A systemic approach utilising behavioural theory, technology and an understanding of healthcare delivery systems. In Proceedings of the Design Society: International Conference on Engineering Design (Vol. 1, No. 1, pp. 937–946). Cambridge University Press. https://doi.org/10.1017/dsi.2019.98
  • Consoli, D., & Mina, A. (2009). An evolutionary perspective on health innovation systems. Journal of Evolutionary Economics, 19(2), 297–319. https://doi.org/10.1007/s00191-008-0127-3
  • Dot, R. (2021). CoreCare. Red dot design award: CoreCare. Retrieved December 7, 2021, from https://www.red-dot.org/project/corecare-54159.
  • Drennan, V. M., & Ross, F. (2019). Global nurse shortages: The facts, the impact and action for change. British Medical Bulletin, 130(1), 25–37. https://doi.org/10.1093/bmb/ldz014
  • Duffy, A., Christie, G. J., & Moreno, S. (2022). The challenges toward real-world implementation of digital health design approaches: Narrative review. JMIR Human Factors, 9(3), e35693. https://doi.org/10.2196/35693
  • Feinberg, M. (2017, May). A design perspective on data. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 2952–2963). https://doi.org/10.1145/3025453.3025837
  • Freeman, P., & Wasserman, A. I. (1983). Fundamentals of design. In Freeman, P. (Ed.), Software design techniques (4th ed., pp. 12). IEEE Computer Society.
  • Friedman, C. P., Wong, A. K., & Blumenthal, D. (2010). Achieving a nationwide learning health system. Science Translational Medicine, 2(57), cm5729–cm5729. https://doi.org/10.1126/scitranslmed.3001456
  • Furner, J. (2016). Data”: The data. In Information cultures in the digital age (pp. 287–306). Springer VS. https://doi.org/10.1007/978-3-658-14681-8_17
  • Gopal, G., Suter-Crazzolara, C., Toldo, L., & Eberhardt, W. (2019). Digital transformation in healthcare–architectures of present and future information technologies. Clinical Chemistry and Laboratory Medicine (CCLM), 57(3), 328–335. https://doi.org/10.1515/cclm-2018-0658
  • Gorb, P., & Dumas, A. (1987). Silent design. Design Studies, 8(3), 150–156. https://doi.org/10.1016/0142-694x(87)90037-8
  • Greene, S. M., Reid, R. J., & Larson, E. B. (2012). Implementing the learning health system: From concept to action. Annals of Internal Medicine, 157(3), 207–210. https://doi.org/10.7326/0003-4819-157-3-201208070-00012
  • Gulliksen, J., Göransson, B., Boivie, I., Blomkvist, S., Persson, J., & Cajander, Å. (2003). Key principles for user-centred systems design. Behaviour and Information Technology, 22(6), 397–409. https://doi.org/10.1080/01449290310001624329
  • Gulotta, R., Odom, W., Forlizzi, J., & Faste, H. (2013, April). Digital artifacts as legacy: Exploring the lifespan and value of digital data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1813–1822). https://doi.org/10.1145/2470654.2466240
  • Haggerty, E. (2017). Healthcare and digital transformation. Network Security, 2017(8), 7–11. https://doi.org/10.1016/S1353-4858(17)30081-8
  • Hoste, E. A., Bagshaw, S. M., Bellomo, R., Cely, C. M., Colman, R., Cruz, D. N., Edipidis, K., Forni, L. G., Gomersall, C. D., Govil, D., & Kellum, J. A. (2015). Epidemiology of acute kidney injury in critically ill patients: The multinational AKI-EPI study. Intensive Care Medicine, 41(8), 1411–1423. https://doi.org/10.1007/s00134-015-3934-7
  • Jakobson, T., Karjagin, J., Vipp, L., Padar, M., Parik, A. H., Starkopf, L., Kern, H., Tammik, O., & Starkopf, J. (2014). Postoperative complications and mortality after major gastrointestinal surgery. Medicina, 50(2), 111–117. https://doi.org/10.1016/j.medici.2014.06.002
  • Jalote-Parmar, A., Badke-Schaub, P., Ali, W., & Samset, E. (2010). Cognitive processes as integrative component for developing expert decision-making systems: A workflow centered framework. Journal of Biomedical Informatics, 43(1), 60–74. https://doi.org/10.1016/j.jbi.2009.07.001
  • Jansen, J. M., Niemantsverdriet, K., Burghoorn, A. W., Lovei, P., Neutelings, I., Deckers, E., & Nienhuijs, S. (2020). Design for Co-responsibility: Connecting patients, partners, and professionals in bariatric lifestyle changes. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (pp. 1537–1549). https://doi.org/10.1145/3357236.3395469
  • Jennings, P., & Hussain, S. (2020). Do-it-yourself artificial pancreas systems: A review of the emerging evidence and insights for healthcare professionals. Journal of Diabetes Science and Technology, 14(5), 868–877. https://doi.org/10.1177/1932296819894296
  • Komashie, A., Lame, G., Patou, F., Ciccone, N., Maier, A., & Clarkson, P. J. (2019). Exploring healthcare systems design research and practice: Outcomes of an international meeting. In Proceedings of the Design Society: International Conference on Engineering Design (Vol. 1, No. 1, pp. 947–956). Cambridge University Press. https://doi.org/10.1017/dsi.2019.98
  • Komashie, A., Ward, J., Bashford, T., Dickerson, T., Kaya, G. K., Liu, Y., Kuhn, I., Günay, A., Kohler, K., Boddy, N., & Clarkson, P. J. (2021). Systems approach to health service design, delivery and improvement: A systematic review and meta-analysis. British Medical Journal Open, 11(1), e037667. https://doi.org/10.1136/bmjopen-2020-037667
  • Kowatsch, T., Otto, L., Harperink, S., Cotti, A., & Schlieter, H. (2019). A design and evaluation framework for digital health interventions. IT-Information Technology, 61(5–6), 253–263. https://doi.org/10.1515/itit-2019-0019
  • Lewis, D. (2016, May 12). How I designed a “DIY” closed loop artificial pancreas. DIYPS.Org. https://diyps.org/2016/05/12/how-i-designed-a-diy-closed-loop-artificial-pancreas/
  • Lewis, D. M. (2019). Do-it-Yourself artificial pancreas system and the OpenAPS Movement. Endocrinology and Metabolism Clinics of North America, 49(1), 203–213. https://doi.org/10.1016/j.ecl.2019.10.005
  • Lovei, P., Deckers, E., Funk, M., & Wensveen, S. (2020). The Marios and Luigis of design: Design plumbers Wanted! In Companion Publication of the 2020 ACM Designing Interactive Systems Conference (pp. 197–201). https://doi.org/10.1145/3393914.3395898
  • Lovei, P., van Dijk, R., Jansen, J. M., Deckers, E., Niemantsverdriet, K., Burghoorn, A. W., Neutelings I., & Nienhuijs, S. (2020). Together in shape: A Co-responsibility system to support bariatric lifestyle changes. In Companion Publication of the 2020 ACM Designing Interactive Systems Conference (pp. 361–364). https://doi.org/10.1145/3393914.3397094
  • Manteghinejad, A., & Javanmard, S. H. (2021). Challenges and opportunities of digital health in a post-COVID19 world. Journal of Research in Medical Sciences: The Official Journal of Isfahan University of Medical Sciences, 26(1), 11. https://doi.org/10.4103/jrms.JRMS_1255_20
  • McGinnis, J. M., Powers, B., & Grossmann, C. (2011). Digital infrastructure for the learning health system: The foundation for continuous improvement in health and health care: Workshop series summary. National Academies press. https://doi.org/10.17226/12912
  • McGinnis, J. M., Stuckhardt, L., Saunders, R., & Smith, M. (Eds.). (2013). Best care at lower cost: The path to continuously learning health care in America. National Academies press. https://doi.org/10.17226/13444
  • Mummah, S. A., Robinson, T. N., King, A. C., Gardner, C. D., & Sutton, S. (2016). IDEAS (integrate, design, assess, and share): A framework and toolkit of strategies for the development of more effective digital interventions to change health behavior. Journal of Medical Internet Research, 18(12), e317. https://doi.org/10.2196/jmir.5927
  • Nepal, S., Jang-Jaccard, J., Celler, B., Yan, B., & Alem, L. (2013, October). Data architecture for telehealth services research: A case study of home tele-monitoring. In 9th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing (pp. 458–467). IEEE. https://doi.org/10.4108/icst.collaboratecom.2013.254220
  • Noortman, R., Lovei, P., Funk, M., Deckers, E., Wensveen, S., & Eggen, B. (2022). Breaking up data-enabled design: Expanding and scaling up for the clinical context. Ai Edam, 36. https://doi.org/10.1017/S0890060421000433
  • O’Donnell, S., Lewis, D., Fernández, M. M., Wäldchen, M., Cleal, B., Skinner, T., Raile, K., Tappe, A., Ubben, T., Willaing, I., & Braune, K. (2019). Evidence on user-led innovation in diabetes technology (the OPEN project): Protocol for a mixed methods study. JMIR Research Protocols, 8(11), e15368. https://doi.org/10.2196/15368
  • OpenAPS Outcomes. (2021). OPENAPS.ORG. https://openaps.org/outcomes/
  • Pagliari, C. (2007). Design and evaluation in eHealth: Challenges and implications for an interdisciplinary field. Journal of Medical Internet Research, 9(2), e614. https://doi.org/10.2196/jmir.9.2.e15
  • Pannunzio, V. (2023a). Towards a convergent approach to the use of data in digital health design [ Doctoral dissertation]. Delft University of Technology. https://doi.org/10.4233/uuid:7b9395d3-a654-4a6e-8c98-35eb5901194e
  • Pannunzio, V., Kleinsmann, M. S., & Snelders, H. M. J. J. (2019). Design research, eHealth, and the convergence revolution. In IASDR 2019: International Association of Societies of Design Research Conference 2019. Manchester, UK.
  • Pannunzio, V., Lovei, P., Neutelings, I., Deckers, E., Jansen, J. M., & Burghoorn, A. W. (2020). Exploring the service system perspective on designing intelligent health ecosystems: The co-responsibility study. In 6th International Conference on Design4Health2020/Online. Amsterdam, NL (in-person event cancelled due to pandemic). (pp. 469–477). Sheffield Hallam University.
  • Pannunzio, V., Morales Ornelas, H. C., Gurung, P., van Kooten, R., van Os, H., Wouters, M., Tollenaar, R., Kleinsmann, M., Snelders, D., & Atsma, D. (2023b). Patient and staff experience in remote patient monitoring; what to measure and how? A systematic review (Preprint). Journal of Medical Internet Research (Submitted). https://doi.org/10.2196/preprints.48463
  • Park, J. H. (2015). Health care design: Current and potential research and development. Design Issues, 31(1), 63–72. https://doi.org/10.1162/DESI_a_00310
  • Powell, J., & Arvanitis, T. N. (2015). Welcome to the digital health revolution. Digital Health, 1, 1. https://doi.org/10.1177/2055207614561571
  • Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022). AI in health and medicine. Nature Medicine, 28(1), 31–38. https://doi.org/10.1038/s41591-021-01614-0
  • Rouse, W. B. (2008). Health care as a complex adaptive system: Implications for design and management. Bridge-Washington-National Academy of Engineering-, 38(1), 17.
  • Sanders, E. B. N., & Stappers, P. J. (2008). Co-creation and the new landscapes of design. Co-Design, 4(1), 5–18. https://doi.org/10.1080/15710880701875068
  • Sanders, E. B. N., & Stappers, P. J. (2012). Convivial toolbox: Generative research for the front end of design. BIS.
  • Schoepen, M., Vansteenkiste, E., De Gersem, W., & Detand, J. (2022). Systems thinking and designerly tools for medical device design in engineering curricula. Health Systems, 1–11. https://doi.org/10.1080/20476965.2022.2072778
  • Sharp, P., Jacks, T., & Hockfield, S. (2016). Convergence: The future of health. The convergence revolution. Massachusetts Institute of Technology. https://www.convergencerevolution.net/2016-report
  • Simon, H. A. (1977). The logic of heuristic decision making. In Models of discovery (pp. 154–175). Springer. https://doi.org/10.1007/978-94-010-9521-1_10
  • Snyder, M., & Zhou, W. (2019). Big data and health. Lancet Digital Health, 1(6), e252–e254. https://doi.org/10.1016/S2589-7500(19)30109-8
  • Strauch, B. (2017). Ironies of automation: Still unresolved after all these years. IEEE Transactions on Human-Machine Systems, 48(5), 419–433. https://doi.org/10.1109/thms.2017.2732506
  • Tsekleves, E., & Cooper, R. (2017). Emerging trends and the way forward in design in healthcare: An expert’s perspective. Design Journal, 20(sup1), S2258–S2272. https://doi.org/10.1080/14606925.2017.1352742
  • U.S. Food and Drug Administration. (2020). What is digital health? https://www.fda.gov/medical-devices/digital-health-center-excellence/what-digital-health
  • Van Kollenburg, J., & Bogers, S. J. A. (2019). Data-enabled design: a situated design approach that uses data as creative material when designing for intelligent ecosystems [ Doctoral dissertation]. Technische Universiteit Eindhoven, Technische Universiteit Eindhoven Research output. https://research.tue.nl/en/publications/data-enabled-design-a-situated-design-approach-that-uses-data-as-
  • Van Kollenburg, J., Bogers, S., Rutjes, H., Deckers, E., Frens, J., & Hummels, C. (2018). Exploring the value of parent tracked baby data in interactions with healthcare professionals: A data-enabled design exploration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–12). https://doi.org/10.1145/3173574.3173871
  • van Velsen, L., Ludden, G., & Grünloh, C. (2022). The limitations of user-and human-centered design in an eHealth context and how to move beyond them. Journal of Medical Internet Research, 24(10), e37341. https://doi.org/10.2196/37341
  • Van Velsen, L., Wentzel, J., & Van Gemert-Pijnen, J. E. (2013). Designing eHealth that matters via a multidisciplinary requirements development approach. JMIR Research Protocols, 2(1), e2547. https://doi.org/10.2196/resprot.2547
  • Wachter, R. (2015). The digital doctor. Hope, hype and at the dawn of medicines Computer age. McGraw-Hill Education.
  • Wolff, A., Gerd, K., Gooch, D., Giaccardi, E., & Speed, C. (2016, June). Designing with data: A designerly approach to data and data analytics. In Proceedings of the 2016 ACM Conference Companion Publication on Designing Interactive Systems (pp. 53–56). https://doi.org/10.1145/2908805.2913017
  • Wong, A., Otles, E., Donnelly, J. P., Krumm, A., McCullough, J., DeTroyer-Cooley, O., Pestrue, J., Phillips, M., Konye, J., Penoza, C., & Singh, K. (2021). External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients. JAMA Internal Medicine, 181(8), 1065. https://doi.org/10.1001/jamainternmed.2021.2626
  • Yang, Q., Scuito, A., Zimmerman, J., Forlizzi, J., & Steinfeld, A. (2018, June). Investigating how experienced UX designers effectively work with machine learning. In Proceedings of the 2018 designing interactive systems conference (pp. 585–596). https://doi.org/10.1145/3196709.3196730
  • Yoo, Y., Boland, R. J., Jr., Lyytinen, K., & Majchrzak, A. (2012). Organizing for innovation in the digitized world. Organization Science, 23(5), 1398–1408. https://doi.org/10.1287/orsc.1120.0771
  • Yoo, Y., Lyytinen, K. J., Boland, R. J., & Berente, N. (2010). The next wave of digital innovation: Opportunities and challenges: A report on the research workshop ‘digital challenges in innovation research’. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.1622170
  • Zhang, J., Morley, J., Gallifant, J., Oddy, C., Teo, J. T., Ashrafian, H., Delaney, B., & Darzi, A. (2023). Mapping and evaluating national data flows: transparency, privacy, and guiding infrastructural transformation. Lancet Digital Health, 5(10), e737–e748. https://doi.org/10.1016/S2589-7500(23)00157-7
Supercharge Your Next Research Paper: Research and write your next paper with Jenni AI.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.