Rapid implementation of remote digital primary care in Stockholm and implications for further system-wide implementation: practitioner’s and manager’s experience of the Always Open mobile application

References

• Regeringskansliet. Vision e-hälsa 2025 – gemensamma utgångspunkter för digitalisering i socialtjänst och hälso- och sjukvård [Vision e-health 2025 – common starting points for digitalisation in social services and health and medical care]. Government Office, Stockholm, Sweden, 2016. https://www.regeringen.se/informationsmaterial/2016/04/vision-e-halsa- 2025/.
   Google Scholar
• UK government. A plan for digital health and social care, Policy Paper, UK government. Published 29 June 2022. https://www.gov.uk/government/publications/a-plan-for-digital-health-and-social-care/a-plan-for-digital-health-and-social-care
   Google Scholar
• Greenhalgh T, Vijayaraghavan S, Wherton J, et al. Virtual online consultations: advantages and limitations (VOCAL) study. BMJ Open. 2016;6(1):e009388. doi: 10.1136/bmjopen-2015-009388.
   PubMed Web of Science ®Google Scholar
• Greenhalgh T, Shaw S, Wherton J, Vijayaraghavan S, Morris J, Bhattacharya S, Hanson P, Campbell-Richards D, Ramoutar S, Collard A, Hodkinson I. Real-World Implementation of Video Outpatient Consultations at Macro, Meso, and Micro Levels: Mixed-Method Study. J Med Internet Res. 2018 Dec 17;20(4):e150. doi: 10.2196/jmir.9897.http://www.jmir.org/2018/4/e150/ [PMCID: PMC5930173] [PubMed: 29625956] [CrossRef:.
   PubMed Web of Science ®Google Scholar
• Golinelli D, Boetto E, Carullo G, Nuzzolese AG, Landini MP, Fantini MP. Adoption of Digital Technologies in Health Care During the COVID-19 Pandemic: Systematic Review of Early Scientific Literature. Journal of Medical Internet Research. 2020;22(11), e22280–e22280. doi: 10.2196/22280.
   Web of Science ®Google Scholar
• Petracca F, Ciani O, Cucciniello M, Tarricone R. Harnessing Digital Health Technologies During and After the COVID-19 Pandemic: Context Matters. Journal of medical Internet research. 2020;22(12):e21815– doi: 10.2196/21815.
   PubMed Web of Science ®Google Scholar
• Herrmann M, Boehme P, Mondritzki T, Ehlers JP, Kavadias S, Truebel H. Digital Transformation and Disruption of the Health Care Sector: Internet-Based Observational Study. J Med Internet Res. 2018 Mar 27;20(3):e104 [FREE Full text] [] [Medline: 29588274] doi: 10.2196/jmir.9498.
   PubMed Web of Science ®Google Scholar
• Perakslis ED. Strategies for delivering value from digital technology transformation. Nat Rev Drug Discov 2017 Feb;16(2):71–72. [] [Medline: 28082744] doi: 10.1038/nrd.2016.265.
   PubMed Web of Science ®Google Scholar
• Peek N, Sujan M, Scott P. Digital health and care in pandemic times: impact of COVID-19. BMJ Health Care Inform 2020;27:e100166. doi: 10.1136/bmjhci-2020-100166.
   PubMedGoogle Scholar
• Milos Nymberg V, Borgström Bolmsjö B, Wolff M, Calling S, Gerward S, Sandberg M. Having to learn this so late in our lives…’ Swedish elderly patients’ beliefs, experiences, attitudes and expectations of e-health in primary health care. Scandinavian Journal of Primary Health Care. 2019;37:1, 41–52, doi: 10.1080/02813432.2019.1570612.
   PubMed Web of Science ®Google Scholar
• Gabrielsson-Järhult F, Kjellström S, Areskoug Josefsson K. Telemedicine consultations with physicians in Swedish primary care: a mixed methods study of users’ experiences and care patterns, Scandinavian Journal of Primary Health Care. 2021; 39:2, 204–213, doi: 10.1080/02813432.2021.1913904.
   PubMed Web of Science ®Google Scholar
• Imlach F, McKinlay E, Middleton L, et al. Telehealth consultations in general practice during a pandemic lockdown: survey and interviews on patient experiences and preferences. BMC Fam Pract. 2020; 21, 269. doi: 10.1186/s12875-020-01336-1.
   PubMed Web of Science ®Google Scholar
• Björndell C, Premberg A. Physicians’ experiences of video consultation with patients at a public virtual primary care clinic: a qualitative interview study, Scandinavian Journal of Primary Health Care. 2021; 39:1, 67–76, doi: 10.1080/02813432.2021.1882082.
   PubMed Web of Science ®Google Scholar
• Glock H, Milos Nymberg V, Borgström Bolmsjö B, Holm J, Calling S, Wolff M, Pikkemaat M. Attitudes, Barriers, and Concerns Regarding Telemedicine Among Swedish Primary Care Physicians: A Qualitative Study. International Journal of General Medicine. 2021; Volume 14, pages 9237–9246. doi: 10.2147/IJGM.S334782.
   PubMed Web of Science ®Google Scholar
• Wilson G, Currie O, Bidwell S, Saeed B, Dowell A, Halim AA, Toop L, Richardson A, Savage R, Hudson B. Empty waiting rooms: the New Zealand general practice experience with telehealth during the COVID-19 pandemic. N Z Med J. 2021 Jul 9;134(1538):89–101. PMID: 34239148.
   PubMed Web of Science ®Google Scholar
• Donaghy E, Atherton H, Hammersley V, McNeilly H, Bikker A, Robbins L, et al. Acceptability, benefits, and challenges of video consulting: a qualitative study in primary care. Br J Gen Pract 2019 Sep;69(686):e586–e594, doi: 10.3399/bjgp19X704141.
   PubMed Web of Science ®Google Scholar
• Murphy M, Scott LJ, Salisbury C, et al. Implementation of remote consulting in UK primary care following the COVID-19 pandemic: a mixed-methods longitudinal study. Br J Gen Pract. 2021;71(704):e166–e177. Published 2021 Feb 25. doi: 10.3399/BJGP.2020.0948.
   PubMed Web of Science ®Google Scholar
• Ignatowicz A, Atherton H, Bernstein CJ, Bryce C, Court R, Sturt J, et al. Internet videoconferencing for patient–clinician consultations in long-term conditions: A review of reviews and applications in line with guidelines and recommendations. DIGITAL HEALTH. 2019;5:2055207619845831–2055207619845831 doi: 10.1177/2055207619845831.
   Web of Science ®Google Scholar
• Shaw SE, Seuren LM, Wherton J, et al. Video Consultations Between Patients and Clinicians in Diabetes, Cancer, and Heart Failure Services: Linguistic Ethnographic Study of Video-Mediated Interaction. J Med Internet Res. 2020;22(5):e18378. Published 2020 May 11. doi: 10.2196/18378.
   PubMed Web of Science ®Google Scholar
• Garfan S, Alamoodi AH, Zaidan BB, et al. Telehealth utilization during the Covid-19 pandemic: A systematic review. Comput Biol Med. 2021;138:104878. doi: 10.1016/j.compbiomed.2021.104878.
   PubMed Web of Science ®Google Scholar
• James H, Papoutsi C, Wherton J, Greenhalgh T, Shaw S. Spread, Scale-up, and Sustainability of Video Consulting in Health Care: Systematic Review and Synthesis Guided by the NASSS Framework. 2021. J Med Internet Res 23(1):e23775 doi: 10.2196/23775.
   PubMed Web of Science ®Google Scholar
• Jaklevic MC. Telephone visits surge during the pandemic, but will they last? JAMA. 2020;324(16):1593–1595. doi: 10.1001/jama.2020.17201.
   PubMed Web of Science ®Google Scholar
• Li K, Chen J, Woodward M. How the old-fashioned telephone could become a new way for some to see their doctor. The Conversation. 2020; August 12.
   Google Scholar
• Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, Hinder S, Fahy N, Procter R, Shaw S. Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies, J Med Internet Res 2017;19(11):e367 URL: https://www.jmir.org/2017/11/e367. doi: 10.2196/jmir.8775.
   PubMed Web of Science ®Google Scholar
• Longacre ML, Keleher C, Chwistek M, Odelberg M, Siemon M, Collins M, Fang CY. Developing an Integrated Caregiver Patient-Portal System. Healthcare. 2021; 9(2):193. doi: 10.3390/healthcare9020193.
   Web of Science ®Google Scholar
• Vårdgivarguiden 2022 Alltid Oppet (Always Open Provider guide), December 6, 2021, https://vardgivarguiden.se/it-stod/e-tjanster-och-system/alltid-oppet. Accessed 18 april 2022.
   Google Scholar
• SLSO, 2022” Appen Alltid öppet,” (Application Always Open)[Online]. Available: https://www.slso.sll.se/vard-hos-oss/vardcentralerhuslakarmottagningar/appen-alltid-oppet/. [Accessed 17april 2022].
   Google Scholar
• RS 2022 Rules and guidelines regarding digitization in healthcare, Region Stockholm, accessed 10 December 2022, https://vardgivarguiden.se/avtal/ and https://vardgivarguiden.se/it-stod/digitalisering/regler-och-riktlinjer-for-digitalisering/
   Google Scholar
• Statens Offentliga Utredningar 2019:42. Digifysiskt vårdval Tillgänglig primärvård baserad på behov och kontinuitet, slutbetänkandet, Slutbetänkande av utredningen Styrning för en mer jämlik vård SOU 2019:42, (Swedish Public Inquiry 2019 Digi-physical care choice: accessible primary care based on need and continuity, the final report, Final report of the inquiry “Guidance for more equal care” Stockholm, www.nj.se/offentligapublikationer
   Google Scholar
• SLSO. Stockholms läns sjukvårdsområde (Stockholm County Healthcare Services). Stockholm: SLSO; [Cited 2022 December 18]. Available from: https://www. slso.sll.se
   Google Scholar
• Anell A, Glenngård AH, Merkur S. Sweden health system review. Health systems in transition. 2012;14(5):1–159 (http://www. ncbi. nlm. nih. gov/pubmed/22894 859).
   PubMedGoogle Scholar
• Ohrling M, Solberg Carlsson K, Brommels M. No man is an island: management of the emergency response to the SARS-CoV-2 (COVID-19) outbreak in a large public decentralised service delivery organisation. BMC Health Serv Res. 2022; 22, 371. doi: 10.1186/s12913-022-07716-w.
   PubMed Web of Science ®Google Scholar
• Ohrling M, Tolf S, Solberg-Carlsson K, Brommels M. That's how it should work: the perceptions of a senior management on the value of decentralisation in a service delivery organisation. Journal of Health Organization and Management. 2021, Vol. 35 No. 5, pp. 596–613. doi: 10.1108/JHOM-12-2020-0474.
   Web of Science ®Google Scholar
• Ohrling M, Tolf, S, Solberg-Carlsson K, Brommels, M. Managers do it their way: How managers act in a decentralised healthcare services provider organisation – a mixed methods study. Health Services Management Research : an Official Journal of the Association of University Programs in Health Administration. 2021. 95148482110654–. doi: 10.1177/09514848211065467.
   Google Scholar
• Hsieh HF, Shannon SE. Three Approaches to Qualitative Content Analysis. Qualitative Health Research. 2005; Vol 15, issue 1277. doi: 10.1177/1049732305276687.
   PubMedGoogle Scholar
• Green J, Thorogood N. Qualitative Methods for Health Research (Introducing Qualitative Methods series) (9781446253090): 2014. Judith Green, Nicki Thorogood: Books. pp 95–96.
   Google Scholar
• Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32 item checklist for interviews and focus groups. International Journal for Quality in Health Care. 2007, Volume 19, Number 6: pp. 349–357. doi: 10.1093/intqhc/mzm042.
   PubMed Web of Science ®Google Scholar
• GDPR (2016) Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation), OJ 2016 L 119/1 http://ec.europa.eu/justice/data-protection/reform/files/regulation_oj_en.pdf
   Google Scholar
• Ohannessian R, Duong TA, Odone A. Global telemedicine implementation and integration within health systems to fight the COVID-19 pandemic: a call to action. JMIR Public Health Surveill 2020 Apr 02;6(2):e18810 [FREE Full text] [doi: 10.2196/18810].[Medline: 32238336]
   PubMedGoogle Scholar
• Lonergan PE, Washington Iii SL, Branagan L, Gleason N, Pruthi RS, Carroll PR, et al. Rapid utilization of telehealth in a comprehensive cancer center as a response to COVID-19: cross-sectional analysis. J Med Internet Res 2020 Jul 06;22(7):e19322 [FREE Full text] [] [Medline: 32568721] doi: 10.2196/19322.
   PubMed Web of Science ®Google Scholar
• Pérez Sust P, Solans O, Fajardo JC, Medina Peralta M, Rodenas P, Gabaldà J, et al. Turning the crisis into an opportunity: digital health strategies deployed during the COVID-19 outbreak. JMIR Public Health Surveill 2020 May 04;6(2):e19106 [FREE Full text] [] [Medline: 32339998] doi: 10.2196/19106.
   PubMedGoogle Scholar
• Hong Z, Li N, Li D, Li J, Li B, Xiong W, et al. Telemedicine during the COVID-19 pandemic: experiences from western China. J Med Internet Res 2020 May 08;22(5):e19577 [FREE Full text] [] [Medline: 32349962] doi: 10.2196/19577.
   PubMed Web of Science ®Google Scholar
• Greenhalgh T, Ladds E, Hughes G, Moore L, Wherton J, Shaw S E, Papoutsi C,Wieringa S, Rosen R, Rushforth A, Rybczynska-Bunt S. 2022. Why do GPs rarely do video consultations? Qualitative study in general practice. British Journal of General Practice. e351-360. doi: 10.3399/BJGP.2021.0658.
   Google Scholar
• Juergens N, Huang J, Gopalan A, Muelly E, Reed M. 2022. The association between video or telephone telemedicine visit type and orders in primary care. BMC Medical Informatics and Decision Making. 22:302. doi: 10.1186/s12911-022-02040-z.
   PubMed Web of Science ®Google Scholar
• Tasneem S, Kim A, Bagheri A, Lebert J. 2019. Telemedicine Video Visits for patients receiving palliative care: A qualitative study. American Journal of Hospice & Palliative Medicine. Vol. 36(9) 789–794. doi: 10.1177/10499091.19846843.
   PubMed Web of Science ®Google Scholar
• Viers B R,Lightner D J, Rivera M E, Tollefson M K, Boorjian S A, Karnes R J, Thompson R H, O’Neill D A, Hamilton R L, Gardner M R, Bundrick M, Jenkins S M, Pruthi S, Frank I, Gettman M T. 2015. Efficiency, Satisfaction and Costs for Remote Video Visits Following Radical Prostatectomy: A Randomized Controlled Trial. European Urology. 68;729–735. doi: 10.1016/j.eururo.2015.04.002.
   PubMed Web of Science ®Google Scholar
• Yan X, Stults C D, Deng S, Liang, S-Y, Dillon E, Mudiganti S, Oscarson B, Jones J B, Frosch D L. 2022. Do Patients Continue to Use Video Visits? Factors Related to Continued Video Visit Use. Population Health Management. 25;4. doi: 10.1089/pop.2021.0353.
   PubMed Web of Science ®Google Scholar
• Ragnedda, M. The Third Digital Divide: A Weberian Approach to Digital Inequalities, 2017. Routledge, Oxford
   Google Scholar
• Honeyman M, Maguire D, Evans H and Davies A. (2020). Digital technology and health inequalities: a scoping review. 2020. Cardiff: Public Health Wales NHS Trust
   Google Scholar
• Huang J, Graetz I, Millman A, Gopalan A, Lee C, Muelly E, Reed M. 2022. Primary care telemedicine during the COVID-19 pandemic: patient’s choice of video versus telephone visit.American Medical Informatics Association, JAMIA Open. 5(1), 1–5. doi: 10.1093/jamiaopen/ooac002.
   Google Scholar
• Keesara S, Jonas A, Schulman K. Covid-19 and Health Care's Digital Revolution. N Engl J Med. 2020 Jun 04;382(23):e82. [doi: 10.1056/NEJMp2005835].[Medline: 32240581] 5.
   PubMed Web of Science ®Google Scholar
• Shaw S, Wherton J, Vijayaraghavan S, Morris J, Bhattacharya S, Hanson P, et al. Advantages and limitations of virtual online consultations in a NHS acute trust: the VOCAL mixed-methods study. Southampton (UK): NIHR Journals Library; 2018. doi: 10.3310/hsdr06210.
   Google Scholar
• Heltveit-Olsen SR, Lunde L, Brænd AM, Spehar I, Høye S, Skoglund I, Sundvall P-D, Haugen Fossum G, Straand J, Bech Risør M. 2022. Experiences and management strategies of Norwegian GPs during the COVID-19 pandemic: a longitudinal interview study, Scandinavian Journal of Primary Health Care, doi: 10.1080/02813432.2022.2142796.
   PubMed Web of Science ®Google Scholar
• Due TD, Thorsen T, Andersen JH. Use of alternative consultation forms in Danish general practice in the initial phase of the COVID-19 pandemic – a qualitative study. 2021. BMC Fam Pract. 22, 108. doi: 10.1186/s12875-021-01468-y.
   PubMed Web of Science ®Google Scholar
• Greenhalgh T, Maylor H, Shaw S, Wherton J, Papoutsi C, Betton V, Nelissen N, Gremyr A, Rushforth A, Koshkouei M, Taylor J. The NASSS-CAT Tools for Understanding, Guiding, Monitoring, and Researching Technology Implementation Projects in Health and Social Care: Protocol for an Evaluation Study in Real-World Settings. JMIR Res Protoc 2020;9(5):e16861 doi: 10.2196/16861.
   PubMed Web of Science ®Google Scholar
• Gremyr A, Gare BA, Greenhalgh T, Malm U, Thor J, Andersson A-C. Using Complexity Assessment to Inform the Development and Deployment of a Digital Dashboard for Schizophrenia Care: Case Study. Journal of medical Internet research. 2020;22(4):e15521–e15521. doi: 10.2196/15521.
   Web of Science ®Google Scholar
• Yakovchenko V, McInnes D, Petrakis B, Gillespie C, Lipschitz J, McCullough, M., Richardson L, Vetter B, Hogan T Implementing Automated Text Messaging for Patient Self-management in the Veterans Health Administration: Qualitative Study Applying the Nonadoption, Abandonment, Scale-up, Spread, and Sustainability Framework JMIR Mhealth Uhealth 2021;9(11):e31037 doi: 10.2196/31037.
   PubMed Web of Science ®Google Scholar
• Rudin RS, Perez S, Rodriguez JA, Sousa J, Plombon S, Arcia A, Foer D, Bates, DW, Dalal, AK. User-centered design of a scalable, electronic health record-Integrated remote symptom monitoring intervention for patients with asthma and providers in primary care. 2021. J Am Med Inform Assoc. Oct 12;28(11):2433–2444. doi: 10.1093/jamia/ocab157.
   PubMed Web of Science ®Google Scholar