Quantifying the qualitative: exploring epistemic network analysis as a method to study work system interactions

References

• Alzheimer’s Association. 2018. “2018 Alzheimer’s Disease Facts and Figures.” Alzheimer's Dementia 14 (3): 367–429.
   Web of Science ®Google Scholar
• Åsberg, R., D. Hummerdal, and S. Dekker. 2011. “There Are No Qualitative Methods–nor Quantitative for That Matter: The Misleading Rhetoric of the Qualitative–Quantitative Argument.” Theoretical Issues in Ergonomics Science 12 (5): 408–415. doi:10.1080/1464536X.2011.559292.
   Google Scholar
• Barriball, K. L., and A. While. 1994. “Collecting Data Using a Semi-structured Interview: A Discussion Paper.” Journal of Advanced Nursing 19 (2): 328–335. doi:10.1111/j.1365-2648.1994.tb01088.x.
   PubMed Web of Science ®Google Scholar
• Barry, C A., N. Britten, N. Barber, C. Bradley, and F. Stevenson. 1999. “Using Reflexivity to Optimize Teamwork in Qualitative Research.” Qualitative Health Research 9 (1): 26–44. doi:10.1177/104973299129121677.
   PubMed Web of Science ®Google Scholar
• Bird, M., and E. Moniz-Cook. 2008. “Challenging Behaviour in Dementia: A Psychosocial Approach to Intervention.” In Handbook of the Clinical Psychology of Ageing, 571–594. Chichester: Willey.
   Google Scholar
• Brodaty, H., and M. Donkin. 2009. “Family Caregivers of People With Dementia.” Dialogues in Clinical Neuroscience 11 (2): 217–228.
   PubMedGoogle Scholar
• Brohinsky, J., Cody Marquart, Junting Wang, A. R. Ruis, and David Williamson Shaffer. 2021. “Trajectories in Epistemic Network Analysis.” In International Conference on Quantitative Ethnography. Springer.
   Google Scholar
• Cai, Z., Amanda Siebert-Evenstone, Brendan Eagan, and David Williamson Shaffer. 2021. “Using Topic Modeling for Code Discovery in Large Scale Text Data.” In International Conference on Quantitative Ethnography. Springer.
   Google Scholar
• Carayon, P. 2006. “Human Factors of Complex Sociotechnical Systems.” Applied Ergonomics 37 (4): 525–535. doi:10.1016/j.apergo.2006.04.011.
   PubMed Web of Science ®Google Scholar
• Carayon, P. 2009. “The Balance Theory and the Work System Model… Twenty Years Later.” International Journal of Human-Computer Interaction 25 (5): 313–327. doi:10.1080/10447310902864928.
   Web of Science ®Google Scholar
• Carayon, P., A Schoofs Hundt, C J. Alvarado, S R. Springman, and P. Ayoub. 2006. “Patient Safety in Outpatient Surgery: The Viewpoint of the Healthcare Providers.” Ergonomics 49 (5–6): 470–485. doi:10.1080/00140130600568717.
   PubMed Web of Science ®Google Scholar
• Carayon, P., A. Schoofs Hundt, B-T. Karsh, A P. Gurses, C J. Alvarado, M. Smith, and P. Flatley Brennan. 2006. “Work System Design for Patient Safety: The SEIPS Model.” Quality and Safety in Health Care 15 (suppl 1): i50–i58. doi:10.1136/qshc.2005.015842.
   PubMedGoogle Scholar
• Carayon, P., and M. J. Smith. 2000. “Work Organization and Ergonomics.” Applied Ergonomics 31 (6): 649–662. doi:10.1016/S0003-6870(00)00040-5.
   PubMed Web of Science ®Google Scholar
• Carayon, Pascale, Tosha B. Wetterneck, A Joy Rivera-Rodriguez, Ann Schoofs Hundt, Peter Hoonakker, Richard Holden, and Ayse P. Gurses. 2014. “Human Factors Systems Approach to Healthcare Quality and Patient Safety.” Applied Ergonomics 45 (1): 14–25. doi:10.1016/j.apergo.2013.04.023.
   PubMed Web of Science ®Google Scholar
• Corbin, J., and A. Strauss. 1985. “Managing Chronic Illness at Home: Three Lines of Work.” Qualitative Sociology 8 (3): 224–247. doi:10.1007/BF00989485.
   Google Scholar
• Crandall, B., G. Klein, and R. R. Hoffman. 2006. Working Minds: A Practitioner’s Guide to Cognitive Task Analysis. Cambridge, MA: MIT Press.
   Google Scholar
• Czaja, S. J. 2019. Designing for Older Adults: Principles and Creative Human Factors Approaches. Boca Raton: CRC Press.
   Google Scholar
• Donabedian, A. 1966. “Evaluating the Quality of Medical Care.” The Milbank Memorial Fund Quarterly 44 (3): 166–206. doi:10.2307/3348969.
   PubMedGoogle Scholar
• Donabedian, A. 1978. “The Quality of Medical Care.” Science (New York, N.Y.) 200 (4344): 856–864. doi:10.1126/science.417400.
   PubMed Web of Science ®Google Scholar
• Dul, Jan, Ralph Bruder, Peter Buckle, Pascale Carayon, Pierre Falzon, William S. Marras, John R. Wilson, and Bas van der Doelen. 2012. “A Strategy for Human Factors/Ergonomics: Developing the Discipline and Profession.” Ergonomics 55 (4): 377–395. doi:10.1080/00140139.2012.661087.
   PubMed Web of Science ®Google Scholar
• Forbes, D. A., S. Finkelstein, C.M. Blake, M. Gibson, D.G. Morgan, M. Markle-Reid, I. Culum, and E. Thiessen. 2012., Knowledge exchange throughout the dementia care journey by Canadian rural community-based health care practitioners, persons with dementia, and their care partners: an interpretive descriptive study.
   Google Scholar
• Games, E. 2016. Epistemic Network Analysis. Madison, WI: Epistemic Games Group.
   Google Scholar
• Geda, Yonas E., Lon S. Schneider, Laura N. Gitlin, David S. Miller, Gwenn S. Smith, Joanne Bell, Jovier Evans, Michael Lee, Anton Porsteinsson, Krista L. Lanctôt, Paul B. Rosenberg, David L. Sultzer, Paul T. Francis, Henry Brodaty, Prasad P. Padala, Chiadikaobi U. Onyike, Luis Agüera Ortiz, Sonia Ancoli-Israel, Donald L. Bliwise, Jennifer L. Martin, Michael V. Vitiello, Kristine Yaffe, Phyllis C. Zee, Nathan Herrmann, Robert A. Sweet, Clive Ballard, Ni A. Khin, Cara Alfaro, Patrick S. Murray, Susan Schultz, and Constantine G. Lyketsos. 2013. “Neuropsychiatric Symptoms in Alzheimer's Disease: Past Progress and Anticipation of the Future.” Alzheimer's & Dementia : The Journal of the Alzheimer's Association 9 (5): 602–608. doi:10.1016/j.jalz.2012.12.001.
   PubMed Web of Science ®Google Scholar
• Gee, J. P. 2014. An Introduction to Discourse Analysis: Theory and Method. London: Routledge.
   Google Scholar
• Gurses, A. P., and P. Carayon. 2009. “Exploring Performance Obstacles of Intensive Care Nurses.” Applied Ergonomics 40 (3): 509–518. doi:10.1016/j.apergo.2008.09.003.
   PubMed Web of Science ®Google Scholar
• Hackman, J. R. 2003. “Learning More by Crossing Levels: Evidence from Airplanes, Hospitals, and Orchestras.” Journal of Organizational Behavior 24 (8): 905–922. doi:10.1002/job.226.
   Web of Science ®Google Scholar
• Hay, G. J., F. E. Klonek, and S. K. Parker. 2020. “Diagnosing Rare Diseases: A Sociotechnical Approach to the Design of Complex Work Systems.” Applied Ergonomics 86: 103095. doi:10.1016/j.apergo.2020.103095.
   PubMed Web of Science ®Google Scholar
• Holden, R. J., C. C. Schubert, and R. S. Mickelson. 2015. “The Patient Work System: An Analysis of Self-Care Performance Barriers Among Elderly Heart Failure Patients and Their Informal Caregivers.” Applied Ergonomics 47: 133–150. doi:10.1016/j.apergo.2014.09.009.
   PubMed Web of Science ®Google Scholar
• Holden, Richard J., Pascale Carayon, Ayse P. Gurses, Peter Hoonakker, Ann Schoofs Hundt, A Ant Ozok, and A Joy Rivera-Rodriguez. 2013. “SEIPS 2.0: A Human Factors Framework for Studying and Improving the Work of Healthcare Professionals and Patients.” Ergonomics 56 (11): 1669–1686. doi:10.1080/00140139.2013.838643.
   PubMed Web of Science ®Google Scholar
• Holden, Richard J., Roger L. Brown, Samuel J. Alper, Matthew C. Scanlon, Neal R. Patel, and Ben-Tzion Karsh. 2011. “That’s Nice, But What Does IT Do? Evaluating the Impact of Bar Coded Medication Administration by Measuring Changes in the Process of Care.” International Journal of Industrial Ergonomics 41 (4): 370–379. doi:10.1016/j.ergon.2011.02.007.
   PubMed Web of Science ®Google Scholar
• Holden, Richard J., Rupa S. Valdez, Christiane C. Schubert, Morgan J. Thompson, and Ann S. Hundt. 2017. “Macroergonomic Factors in the Patient Work System: Examining the Context of Patients with Chronic Illness.” Ergonomics 60 (1): 26–43. doi:10.1080/00140139.2016.1168529.
   PubMed Web of Science ®Google Scholar
• Hutchinson, S. A., and H. S. Wilson. 1992. “Validity Threats in Scheduled Semistructured Research Interviews.” Nursing Research, 41: 117–119.
   PubMed Web of Science ®Google Scholar
• Jensen, C. J., and J. Inker. 2015. “Strengthening the Dementia Care Triad: Identifying Knowledge Gaps and Linking to Resources.” American Journal of Alzheimer’s Disease and Other Dementias 30 (3): 268–275. doi:10.1177/1533317514545476.
   PubMed Web of Science ®Google Scholar
• Johnson, R. B., A. J. Onwuegbuzie, and L. A. Turner. 2007. “Toward a Definition of Mixed Methods Research.” Journal of Mixed Methods Research 1 (2): 112–133. doi:10.1177/1558689806298224.
   Web of Science ®Google Scholar
• Kales, H. C., L. N. Gitlin, and C. G. Lyketsos. 2015. “Assessment and Management of Behavioral and Psychological Symptoms of Dementia.” BMJ (Clinical Research ed.) 350: h369–h369. doi:10.1136/bmj.h369.
   PubMed Web of Science ®Google Scholar
• Karsh, B. -T. 2006. “Meso-Ergonomics: A New Paradigm for Macroergonomics Research.” In Proceedings of the International Ergonomics Association, 742–750.
   Google Scholar
• Karsh, B. -T., and S. J. Alper. 2005. “Work System Analysis: The Key to Understanding Health Care Systems.” Agency for Healthcare Research and Quality : 337–348.
   Google Scholar
• Karsh, B-T., R J. Holden, S J. Alper, and C K L. Or. 2006. “A Human Factors Engineering Paradigm for Patient Safety: Designing to Support the Performance of the Healthcare Professional.” Quality in Health Care 15 (suppl 1): i59–i65. doi:10.1136/qshc.2005.015974.
   Google Scholar
• Lawton, Rebecca, Rosemary R C. McEachan, Sally J. Giles, Reema Sirriyeh, Ian S. Watt, and John Wright. 2012. “Development of an Evidence-Based Framework of Factors Contributing to Patient Safety Incidents in Hospital Settings: A Systematic Review.” BMJ Quality & Safety 21 (5): 369–380. doi:10.1136/bmjqs-2011-000443.
   PubMed Web of Science ®Google Scholar
• Misiejuk, K., Jennifer Scianna, Rogers Kaliisa, Karl Vachuska, David Williamson Shaffer. 2021. “Incorporating Sentiment Analysis with Epistemic Network Analysis to Enhance Discourse Analysis of Twitter Data.” In International Conference on Quantitative Ethnography. Springer.
   Google Scholar
• Namey, Emily, Greg Guest, Kevin McKenna, and Mario Chen. 2016. “Evaluating Bang for the Buck: A Cost-Effectiveness Comparison Between Individual Interviews and Focus Groups Based on Thematic Saturation Levels.” American Journal of Evaluation 37 (3): 425–440. doi:10.1177/1098214016630406.
   Web of Science ®Google Scholar
• Nichols, Emma, Cassandra E. I. Szoeke, Stein Emil Vollset, Nooshin Abbasi, Foad Abd-Allah, Jemal Abdela, Miloud Taki Eddine Aichour, Rufus O. Akinyemi, Fares Alahdab, Solomon W. Asgedom, Ashish Awasthi, Suzanne L. Barker-Collo, Bernhard T. Baune, Yannick Béjot, Abate B. Belachew, Derrick A. Bennett, Belete Biadgo, Ali Bijani, Muhammad Shahdaat Bin Sayeed, Carol Brayne, David O. Carpenter, Félix Carvalho, Ferrán Catalá-López, Ester Cerin, Jee-Young J. Choi, Anh Kim Dang, Meaza G. Degefa, Shirin Djalalinia, Manisha Dubey, Eyasu Ejeta Duken, David Edvardsson, Matthias Endres, Sharareh Eskandarieh, Andre Faro, Farshad Farzadfar, Seyed-Mohammad Fereshtehnejad, Eduarda Fernandes, Irina Filip, Florian Fischer, Abadi K. Gebre, Demeke Geremew, Maryam Ghasemi-Kasman, Elena V. Gnedovskaya, Rajeev Gupta, Vladimir Hachinski, Tekleberhan B. Hagos, Samer Hamidi, Graeme J. Hankey, Josep M. Haro, Simon I. Hay, Seyed Sina N. Irvani, Ravi P. Jha, Jost B. Jonas, Rizwan Kalani, André Karch, Amir Kasaeian, Yousef Saleh Khader, Ibrahim A. Khalil, Ejaz Ahmad Khan, Tripti Khanna, Tawfik A M. Khoja, Jagdish Khubchandani, Adnan Kisa, Katarzyna Kissimova-Skarbek, Mika Kivimäki, Ai Koyanagi, Kristopher J. Krohn, Giancarlo Logroscino, Stefan Lorkowski, Marek Majdan, Reza Malekzadeh, Winfried März, João Massano, Getnet Mengistu, Atte Meretoja, Moslem Mohammadi, Maryam Mohammadi-Khanaposhtani, Ali H. Mokdad, Stefania Mondello, Ghobad Moradi, Gabriele Nagel, Mohsen Naghavi, Gurudatta Naik, Long H. Nguyen, Trang H. Nguyen, Yirga L. Nirayo, Molly R. Nixon, Richard Ofori-Asenso, Felix A. Ogbo, Andrew T. Olagunju, Mayowa O. Owolabi, Songhomitra Panda-Jonas, Valéria M de Azeredo Passos, David M. Pereira, Gabriel D. Pinilla-Monsalve, Michael A. Piradov, Constance D. Pond, Hossein Poustchi, Mostafa Qorbani, Amir Radfar, Robert C. Reiner, Stephen R. Robinson, Gholamreza Roshandel, Ali Rostami, Tom C. Russ, Perminder S. Sachdev, Hosein Safari, Saeid Safiri, Ramesh Sahathevan, Yahya Salimi, Maheswar Satpathy, Monika Sawhney, Mete Saylan, Sadaf G. Sepanlou, Azadeh Shafieesabet, Masood A. Shaikh, Mohammad Ali Sahraian, Mika Shigematsu, Rahman Shiri, Ivy Shiue, João P. Silva, Mari Smith, Soheila Sobhani, Dan J. Stein, Rafael Tabarés-Seisdedos, Marcos R. Tovani-Palone, Bach X. Tran, Tung Thanh Tran, Amanuel T. Tsegay, Irfan Ullah, Narayanaswamy Venketasubramanian, Vasily Vlassov, Yuan-Pang Wang, Jordan Weiss, Ronny Westerman, Tissa Wijeratne, Grant M. A. Wyper, Yuichiro Yano, Ebrahim M. Yimer, Naohiro Yonemoto, Mahmoud Yousefifard, Zoubida Zaidi, Zohreh Zare, Theo Vos, Valery L. Feigin, and Christopher J L. Murray. 2019. “Global, Regional, and National Burden of Alzheimer’s Disease and Other Dementias, 1990–2016: A Systematic Analysis for the Global Burden of Disease Study 2016.” The Lancet Neurology 18 (1): 88–106. doi:10.1016/S1474-4422(18)30403-4.
   PubMed Web of Science ®Google Scholar
• Orrill, C. H., and D. W. Shaffer. 2012. Exploring Connectedness: Applying ENA to Teacher Knowledge.
   Google Scholar
• Patton, M. Q. 2014. Qualitative Research & Evaluation Methods: Integrating Theory and Practice. Thousand Oaks, CA: Sage publications.
   Google Scholar
• Pennathur, Priyadarshini R., David Thompson, James H. Abernathy, Elizabeth A. Martinez, Peter J. Pronovost, George R. Kim, Laura C. Bauer, Lisa H. Lubomski, Jill A. Marsteller, and Ayse P. Gurses. 2013. “Technologies in the Wild (TiW): Human Factors Implications for Patient Safety in the Cardiovascular Operating Room.” Ergonomics 56 (2): 205–219. doi:10.1080/00140139.2012.757655.
   PubMed Web of Science ®Google Scholar
• Peterson, Kendra, Howard Hahn, Amber J. Lee, Catherine A. Madison, and Alireza Atri. 2016. “In the Information Age, Do Dementia Caregivers Get the Information They Need? Semi-structured Interviews to Determine Informal Caregivers’ Education Needs, Barriers, and Preferences.” BMC Geriatrics 16 (1): 164. doi:10.1186/s12877-016-0338-7.
   PubMed Web of Science ®Google Scholar
• Ponnala, Siddarth, Laura Block, Aloysius J. Lingg, Amy J. Kind, and Nicole E. Werner. 2020. “Conceptualizing Caregiving Activities for Persons with Dementia (PwD) Through a Patient Work Lense.” Applied Ergonomics 85: 103070. doi:10.1016/j.apergo.2020.103070.
   PubMed Web of Science ®Google Scholar
• Powell, R. A., and H. M. Single. 1996. “Focus Groups.” International Journal for Quality in Health Care : Journal of the International Society for Quality in Health Care 8 (5): 499–504. doi:10.1093/intqhc/8.5.499.
   PubMed Web of Science ®Google Scholar
• Reinhard, S. C., Barbara Given, Nirvana Huhtala Petlick, Ann Bemis, and Ronda G. Hughes. 2008. “Supporting Family Caregivers in Providing Care.” In Patient Safety and Quality: An Evidence-Based Handbook for Nurses. Rockville (MD): Agency for Healthcare Research and Quality (US).
   Google Scholar
• Rupp, A. A., M. Gushta, R. J. Mislevy, and D. W. Shaffer. 2010. “Evidence-Centered Design of Epistemic Games: Measurement Principles for Complex Learning Environments.” The Journal of Technology, Learning and Assessment 8 (4): 3–41.
   Google Scholar
• Shaffer, D. W. 2017. Quantitative Ethnography. Lulu. com. Madison, WI: Cathcart Press.
   Google Scholar
• Shaffer, D. W., W. Collier, and A. R. Ruis. 2016. “A Tutorial on Epistemic Network Analysis: Analyzing the Structure of Connections in Cognitive, Social, and Interaction Data.” Journal of Learning Analytics 3 (3): 9–45. doi:10.18608/jla.2016.33.3.
   Google Scholar
• Shaffer, D., and A. Ruis. 2017. Epistemic Network Analysis: A Worked Example of Theory-Based Learning Analytics. In Handbook of Learning Analytics. New York.
   Google Scholar
• Shaffer, David Williamson, David Hatfield, Gina Navoa Svarovsky, Padraig Nash, Aran Nulty, Elizabeth Bagley, Ken Frank, André A. Rupp, and Robert Mislevy. 2009. “Epistemic Network Analysis: A Prototype for 21st-Century Assessment of Learning.” International Journal of Learning and Media 1 (2): 33–53. doi:10.1162/ijlm.2009.0013.
   Google Scholar
• Siebert-Evenstone, Amanda Lee, Golnaz Arastoopour Irgens, Wesley Collier, Zachari Swiecki, Andrew R. Ruis, and David Williamson Shaffer. 2017. “In Search of Conversational Grain Size: Modelling Semantic Structure Using Moving Stanza Windows.” Journal of Learning Analytics 4 (3): 123–139. doi:10.18608/jla.2017.43.7.
   Google Scholar
• Smith, Michael J., and Pascale C. Sainfort. 1989. “A Balance Theory of Job Design for Stress Reduction.” International Journal of Industrial Ergonomics 4 (1): 67–79. doi:10.1016/0169-8141(89)90051-6.
   Google Scholar
• Strauss, A. 1993. Continual Permutations of Action. New York, NY: Aldine de Gruyter.
   Google Scholar
• Valdez, Rupa S., Richard J. Holden, Laurie L. Novak, and Tiffany C. Veinot. 2015. “Transforming Consumer Health Informatics Through a Patient Work Framework: Connecting Patients to Context.” Journal of the American Medical Informatics Association: JAMIA 22 (1): 2–10. doi:10.1136/amiajnl-2014-002826.
   PubMed Web of Science ®Google Scholar
• Waterson, P. 2009. “A Critical Review of the Systems Approach Within Patient Safety Research.” Ergonomics 52 (10): 1185–1195. doi:10.1080/00140130903042782.
   PubMed Web of Science ®Google Scholar
• Werner, Nicole E., Barbara Stanislawski, Katherine A. Marx, Daphne C. Watkins, Marissa Kobayashi, Helen Kales, and Laura N. Gitlin. 2017. “Getting What They Need When They Need it. Identifying Barriers to Information Needs of Family Caregivers to Manage Dementia-Related Behavioral Symptoms .” Applied Clinical Informatics 8 (1): 191–205. doi:10.4338/ACI-2016-07-RA-0122.
   PubMed Web of Science ®Google Scholar
• Werner, Nicole E., Rachel Rutkowski, Amy Graske, Mary K. Finta, Craig R. Sellers, Sandhya Seshadri, and Manish N. Shah. 2020. “Exploring SEIPS 2.0 as a Model for Analyzing Care Transitions across Work Sstems.” Applied Ergonomics 88: 103141. doi:10.1016/j.apergo.2020.103141.
   PubMed Web of Science ®Google Scholar
• Wiegmann, D. A., and S. A. Shappell. 2003. Human Error Approach to Aviation Accident Analysis: The Human Factors Analysis and Classification System. Aldershot: Ashgate.
   Google Scholar
• Wilson, J. R. 2000. “Fundamentals of Ergonomics in Theory and Practice.” Applied Ergonomics 31 (6): 557–567. doi:10.1016/S0003-6870(00)00034-X.
   PubMed Web of Science ®Google Scholar
• Wilson, J. R. 2014. “Fundamentals of Systems Ergonomics/Human Factors.” Applied Ergonomics 45 (1): 5–13. doi:10.1016/j.apergo.2013.03.021.
   PubMed Web of Science ®Google Scholar
• Woods, D. D., et al. 2010., Behind Human Error. Vol. 2. Surrey: Ashgate.
   Google Scholar
• Wooldridge, Abigail R., Pascale Carayon, David Williamson Shaffer, and Brendan Eagan. 2018. “Quantifying the Qualitative with Epistemic Network Analysis: A Human Factors Case Study of Task-Allocation Communication in a Primary Care Team.” IISE Transactions on Healthcare Systems Engineering 8 (1): 72–82. doi:10.1080/24725579.2017.1418769.
   PubMedGoogle Scholar