465
Views
0
CrossRef citations to date
0
Altmetric
Methods In Addiction Research

Internet-based, continuously available Narcotics Anonymous meetings: a new resource for access to Twelve Step support for abstinence

ORCID Icon, , &
Received 17 Aug 2023, Accepted 21 Jan 2024, Published online: 01 Apr 2024

ABSTRACT

Background: A Zoom-based website was developed in 2020 that offers continuous access to online Narcotics Anonymous (NA) meetings for the first time. This website provides immediate access for persons with substance use disorder to support abstinence from substance-related addictive disorders.

Objectives: This study is designed to characterize attendees employing this online format; to evaluate their experiences for gaining support to maintain abstinence; and to compare the 24/7 experience to face-to-face (FF) meetings they attend.

Methods: An anonymous 33-item survey was made available on the 24/7 NA website that links to the 24/7 meetings. Persons accessing the site could choose to fill out the survey.

Results: 530 respondents completed the survey (64.9% female/35.1% male). Most had stable prior involvement in NA. They had attended more 24/7 meetings (14.9, SD 19.7) than FF meetings (4.6, SD 7.8) in the previous month. 86% had previously attended FF meetings, 48% had served as sponsors, and 92% reported that the 24/7 meetings were more comfortable for them than the FF meetings (p < .001, Cohen’s d = 0.65) and more supportive of abstinence (p < .001, Cohen’s d = 0.91). Of the respondents, 8% were still using drugs, of whom 52% had previously completed some of the Twelve Steps.

Conclusions: The 24/7 format provides a new and easily accessible way for NA members to gain support for abstinence and is positively rated by attendees seeking support for recovery from substance use disorders. It may serve as a valuable adjunct to the traditional FF format.

Introduction

Narcotics Anonymous (NA) is a Twelve-Step (TS) based fellowship that supports abstinence-based recovery from substance use disorders (SUD). It reports over 72,000 weekly meetings in 143 countries (Citation1). Individual NA meetings are available as both traditional face-to-face and fixed-time virtual meetings. In March 2020, NA members developed a website for accessing hourly online Zoom-based meetings on a 24-hour continuous basis. The 24/7 resource provides persons with SUD to have the option to easily enter a virtual NA meeting whenever they choose. Participants can access this resource through the NA website, which they may have heard of from a variety of resources, such as face-to-face NA meetings, contact with NA members they encounter, or clinicians’ recommendations. This study is designed to evaluate this recently developed Internet-based recovery support format.

Use of the Internet for communication between patients and professional caregivers has been found to be a useful option for clinical management for both general medical disorders (Citation2) and for decreased economic cost (Citation3). In the mental health domain, teletherapy has been found to yield clinical results similar to those of face-to-face meetings (Citation4).

Access to face-to-face TS recovery support meetings is reported to be at least as effective as other recovery-oriented psychotherapeutic modalities (Citation5). With regard to long-term outcome, TS meeting attendance over as long as nine years has been associated with long-term abstinence (Citation6). Virtual (online) TS meetings have recently been found to be useful for providing abstinence-based support for recovery from SUD in settings where access to treatment is limited (Citation7). Telehealth appointments have also been found effective in initiating and supporting buprenorphine treatment for opioid maintenance (Citation8).

At the onset of the COVID-19 pandemic, members of NA in Nassau County, NY established an online service on Zoom, accessible through a website, for the NA 24/7 Marathon Meeting. Online meetings are scheduled on an hourly basis and chaired by a rotation of established NA members. The objective was to make continuous (24/7) online NA access available during a period of social isolation, and this format has since continued to be available. A review on teletherapy for substance use disorder overall has revealed satisfaction among patients where it has been applied (Citation9). Additionally, distinctions between experiences in AA and NA merit consideration as well (Citation10,Citation11).

Objective

The objective of the current study is to characterize the 24/7 meetings and their participants, and to compare their internet-based experience to that of the established format of face-to-face (FF) NA meetings they have attended. This is being undertaken to provide a better understanding of the way the online format can help to address the recovery needs of persons with SUDs and to aid clinicians in making use of this emerging format for their patients.

Materials and methods

The NA 24/7 website has a link for interested persons who have accessed it to go to an ongoing 24/7 meeting. After pressing the meeting link on the website, the respondent can enter an ongoing Zoom meeting where participants have the option of making their faces visible. The meeting chairperson selects a participant who volunteers to speak for up to 5 minutes, and then others are selected to speak until the end of the meeting hour. Stably abstinent meeting chairs are changed on the hour. Respondents are also provided with the option of volunteering to complete an anonymous survey, described as a product of a collaboration between “the national NA office and a medical professional” in order to collect data on the effectiveness of the 24/7 meetings. The survey consists of a set of 33 multiple-choice items. Typical items from the survey included “How many of the Twelve Steps have you ever worked with a sponsor? 1 - All, 2 - Some of them, 3 - None of them” and “over the last two weeks, have you been bothered by feeling down, depressed, or hopeless?” No incentives were provided for survey completion, in order to avoid the impact of potential bias for self-selection on respondents’ choice to participate. Responses to the survey in January and February of 2023 were accessed and analyzed. This project was approved by the Institutional Review Board of the Chestnut Health System. The survey was completed anonymously and does not include items that allow for obtaining respondents’ respective identities.

Measures

Information was solicited on geographics, demographics, and specific drug use. Clinically relevant survey items were scored, such as, “Do you feel more comfortable in a 24/7 online meeting than you would in a face-to-face meeting?” and “How effective have you found each of these meeting types: virtual; face to face.” The following items were scored for respondents to answer relative to the last two weeks on a Likert scale ranging from 0–4, with 4 indicating full agreement: comfort at meetings; convenience of meetings; feeling distressed (mean of four items: anxious, worrying, depressed, no pleasure); social anxiety (five items from DSM-5 based social anxiety diagnosis); Twelve-Step belief scale (four items from the Twelve Steps (Citation12)); relief of distress (mean of four items: lonely, craving, depressed, uncertainty); and perceived effectiveness of meetings to support abstinence. Additionally, there are items asking whether the respondent had experienced a spiritual awakening; had worked at least some of the 12 Steps; the number of 24/7 meetings attended last month; and the number of FF meetings attended last month. Last drug use is the number of years since their last use; this was subsequently dichotomized into still using in the past month versus abstinent for one month or longer.

Analysis

Rates of missing data ranged from 0% to 4.3% across all items included in the analysis. Given the low rate of missing data, it is likely that data were missing at random and suitable to being replaced. Records included in the analysis were first sorted on key variables related to the variable where missing data was being replaced. Then missing values were replaced using the Replace Missing Values (RMV) function in SPSS, where missing values were imputed from the median of the nearest ten observations. This method can replace missing data without influencing the mean or variance term, whereas other methods, such as simple substitution or listwise deletion, may impact the distribution (Citation13). This procedure indicates that the appropriate analysis was undertaken to address the issue of missing data.

All measures were analyzed via independent samples t-tests. The first set of analyses compared respondents who attended more 24/7 meetings last month to respondents who attended more FF meetings last month. The second set of analyses compared respondents who perceived 24/7 meetings to be more supportive of their abstinence to respondents who perceived FF meetings to be more supportive of their abstinence. The third set of analyses compared respondents who reported drug use in the past month to those who had been abstinent for one month or longer. Effect sizes were calculated to assess the magnitude of the comparisons between groups (Cohen’s d or, for smaller samples, Hedge’s g). All analyses were conducted using SPSS Statistics version 29.0.1.

Results

Over the course of the two months that the survey was offered, 530 respondents completed it, and data from these respondents were analyzed. (In , data from respondents who scored 24/7 and FF as equivalent were not included). The website was visited by persons from remote settings, as only 10% (N = 53) of attendees lived in the local area where the meetings originated (NY or CT), 76.6% (N = 406) were from other parts of the US, and 13.4% (N = 71) from outside the US. Their mean age was 44.3 (SD 12.5) years, and 64.9% (N = 344) were female. They designated cocaine or crack-cocaine as their “biggest” drug problem (20.8%, N = 110), followed by methamphetamine (20.6%, N = 109), alcohol (16.2%, N = 86), heroin (11.5%, N = 61), other opioids (10.6%, N = 56), marijuana (7.2%, N = 38), fentanyl, (5.3%, N = 28), stimulants (3.8%, N = 20), benzodiazepines (3.8%, N = 20) and methadone or buprenorphine (0.4%, N = 2).

Table 1. Results of independent samples t-tests comparing respondents who attended more 24/7 meetings to respondents who attended more face-to-face meetings.

Respondents reported having attended an average of 14.9 (SD 19.7) 24/7 meetings and 4.55 (SD 7.83) FF meetings in the previous month for a median period of time of 60 minutes at each of the 24/7 meetings. Almost all respondents (96%, N = 509) had previous exposure to one of three NA-related meeting formats: 74.5% (N = 395) had attended 24/7 meetings, 86% (N = 456) had attended an FF meeting, and 76.4% (N = 405) had attended other online NA meetings. 82% (N = 435) reported having experienced a spiritual awakening, 51.5% (N = 273) had a sponsor, and 28.9% (N = 153) had served as sponsors themselves.

One way to distinguish the difference in experiences among attendees to the new 24/7 format is to calculate comparisons between the scores on items listed in the Measures section for the 24/7 and FF items, respectively. These responses were compared relative to two key aspects of the two formats: number of meetings attended in the last month and respondents’ perception of the degree of support for abstinence that the two respective formats provided.

Meeting attendance

: In , respondents who scored 24/7 and FF as equivalent were not included. Of the total 530 respondents, 308 (58.1%) attended more 24/7 meetings, and 115 (21.7%) attended more FF meetings. Respondents who attended more 24/7 meetings reported feeling that 24/7 meetings were more convenient and comfortable than FF meetings. They also reported that the 24/7 meetings provided higher levels of relief from distress and more support for their abstinence, and they had more years of abstinence prior to completing the survey. Their reported scores for craving for substances of misuse were no different between FF and reported 24/7 attendees.

Support for abstinence

compares the respondents who perceived 24/7 to be more supportive of their abstinence than FF meetings. Respondents who perceived 24/7 to be more supportive of their abstinence found 24/7 meetings to be more convenient and more comfortable to attend. They reported higher rates of relief from distress, greater social anxiety, and fewer years of abstinence. There was no difference between the two formats regarding the number of Steps worked, feeling distressed, or craving.

Table 2. Results of independent samples t-tests comparing respondents who perceived 24/7 to be more supportive of their abstinence to respondents who perceived face-to-face to be more supportive of their abstinence.

Respondents who are active drug users

contrasts the characteristics of those respondents who were currently using substances in the month they completed the survey compared to those who were currently abstinent. Many respondents were relatively new to abstinence, as (41%, N = 217) were abstinent only within the last year, but (7.9%, N = 42) had been using drugs within the previous month. Many (47.6%, N = 20) of those still using had completed some of the Steps and (21.4%, N = 9) had a sponsor; most (54.8%, N = 23) of those still using had experienced a spiritual awakening. Those still using had attended fewer meetings (either 24/7 or FF) in the last month and felt more distress, but also viewed the 24/7 meetings as more supportive of their abstinence. Some had served as sponsors (but less than the abstinent respondents). Their craving scores were much higher than those who were currently abstinent. There was, however, no significant difference between the two groups as to whether they reported having had a spiritual awakening or felt 24/7 to be more convenient or comfortable.

Table 3. Results of independent samples t-tests comparing current drug users and non-users.

Discussion

Our findings indicate that there is now a resource whereby people with SUD can access NA meetings from any location and at any time of day by employing a web-based Zoom format. This option was initiated early during the COVID-19 pandemic but is currently accessed well beyond the local area where this format was initiated, and with flexibility at any time of day (or night) for attending. It is reported by the survey respondents to provide relatively more comfort and convenience of access than the FF meetings they have attended.

It is worth noting that the diversity of primary substances of misuse reported by respondents includes methamphetamine and marijuana, for which there are no established pharmacologic approaches to treatment, and alcohol, which illustrates access that parallels that provided by Alcoholics Anonymous.

Many TS members are encouraged to attend a “home group,” i.e. choosing a regularly scheduled FF group which they attend with regularity. These meetings establish familiarity and mutual support with other members they can meet locally outside the FF scheduled meeting times themselves. The 24/7 format does not make this approach to engagement a practical option, as 24/7 attendees encounter a larger number of anonymous attendees from different locales whom they are not likely to personally know. Because of this, this new format may not offer the familiarity and mutuality that may be important for achieving or sustaining recovery that FF groups provide.

Personal psychology and TS engagement

Studies on the impact of TS attendance on the psychology of established members are typically undertaken after a period of membership (Citation11,Citation14,Citation15). The moderating role that personal characteristics can play relative to TS effectiveness has been considered from a theoretical perspective (Citation16), and a variety of issues have been reported to have an impact on the TS experience: the recovery capital that a given person may have (Citation17,Citation18), as well as their cultural context (Citation19,Citation20). Affective (Citation21) and cognitive (Citation22) aspects and the acquisition of the program’s overall ethos (Citation23) over an extended period of TS membership (Citation6) have been reported. Additionally, individual long-term TS members have been shown on fMRI to have acquired the capacity to achieve diminished craving in response to alcohol-related cues upon reciting TS-related prayer (Citation12). Most such research has been done primarily on AA attendees, but two studies have addressed these issues in relation to NA itself (Citation10,Citation11).

We compared respondents who attended more 24/7 than FF meetings as an indicator of how the new format was experienced by them. Convenience and comfort were greater for the 24/7 meetings than for the FF meetings, reflecting key advantages for certain NA members. We also compared the experience of attendees who are still actively using SUD substances with those who were currently abstinent. For both those who were currently using drugs and those abstinent, the new format was on average more convenient and felt more comfortable than the FF meetings. The 24/7 attendees were not necessarily recently abstinent members, as they were no different in having worked any of the Steps or reporting a difference in craving, suggesting that the 24/7 format may serve as a means for relapsed members to re-access the fellowship.

Data were analyzed for which format respondents found more supportive of their abstinence. The 24/7 attendees predominated for social anxiety, suggesting that persons with social anxiety can turn to 24/7 and experience support to a greater extent than in the FF situation. In terms of support for abstinence and relief from distress, those who attended the 24/7 meetings found them preferable to the FF option.

Structure of the health care system

The 24/7 format has emerged at a time when the provision of medical care has experienced similar changes. To date, the format of telemedicine has been evaluated most extensively with regard to changes undertaken during the COVID-19 pandemic, mostly with a focus on primary care medicine (Citation24,Citation25). This includes studies regarding treatment in remote settings with limited access to onsite care (Citation26), changes that may be needed for follow-up (Citation24), access to populations in lower-income countries (Citation7), and cost savings derived (Citation27).

Extensive use of videoconferencing for psychotherapy was introduced long before the COVID-19 pandemic emerged (Citation4). More recently, it has been applied to respective patients in the domain of SUD (Citation28) and initiating and promoting retention of patients on buprenorphine maintenance (Citation8).

The video-based approach studied here illustrates how the 24/7 format can strengthen the overall structure of the NA fellowship. It provides access for established attendees whose previous relationship with the fellowship was strong: 87% of them had attended FF meetings in the past, 52% of them had sponsors, and 29% had even served as sponsors themselves. Respondents were now 3.2 times as likely to have attended 24/7 rather than FF meetings in the previous month, suggesting that some veteran NA members might now make greater use of the 24/7 format. This format was also a resource for respondents who had relapsed, as 50% had experience in working the Steps and 55% of them reported having had a spiritual awakening. It also serves to underline NA members’ participation in a national and international cooperative system.

Cost savings of telehealth have been calculated relative to in-person professional care (Citation29–31). It is notable that our respondents accessed almost three times as many 24/7 meetings as FF meetings in a given month, and this may now reflect an added benefit for them within the NA system of recovery support. It can therefore potentially serve as a multiplier for such savings. A large number of TS sessions are often available in residential rehabilitation settings, but the cost of such settings may be obviated given the large number of 24/7 meetings accessible at home. 24/7 meetings’ cost savings can also be considered relative to the drugs for which more costly, professionally-funded treatments can be employed, particularly, as noted above, for substances for which pharmacologic treatments are found to have limited impact.

Limitations

The sample of respondents reported on here does not provide the option of employing a comparison group of NA members who have not attended 24/7 meetings and whose views may be quite different. The results of this study may be biased in that respondents who engaged more with online meetings may be self-selected because they find the 24/7 meetings more supportive of their abstinence than do those respondents who respond less favorably to online meetings. Further study of the 24/7 format with a larger unselected sample of NA members would be necessary to address this issue. Many persons accessing the 24/7 site may not have chosen to complete the survey for reasons such as the necessary time commitment or the survey response literacy required. This also raises the issue of response bias among respondents, as potential respondents who might see 24/7 as disadvantageous to themselves would be reluctant to answer the survey. The 24/7 format studied here has continued for a relatively limited time since its inception during the COVID-19 pandemic period, and future developments for its use cannot be inferred from the findings reported here. There needs to be further research to address the 24/7 role over a longer term.

Conclusion

The introduction of the 24/7 format has provided a new option for NA members to access other persons seeking recovery from SUD. This is taking place at a time when many patients and healthcare providers have also come to employ Internet-based communication. The findings reported here suggest that the 24/7 format can allow NA members comfort and immediate access to NA support for support of abstinence. The emergence of the 24/7 format for NA attendees therefore offers a new and potentially influential option for the TS format in supporting abstinence for persons with SUD and can be useful for clinicians working with such patients. Future research in this area is therefore useful in clarifying the role that this new format can play in the utility of the TS approach. With more experience with the 24/7 format, it may become clear that particular subgroups of those with substance use disorder may differ in suitability for 24/7 meetings. This can be further clarified with a sample of NA members, overall, and not only those who turn to the NA website.

Acknowledgments

The authors express appreciation for Wilvena Gordon for facilitating contact with NA 24/7. Dr. Jag Khalsa is grateful to the US National Institute on Drug Abuse, DHHS, for an opportunity to serve as a special volunteer following his retirement in 2017 after 30 years as the Chief, Medical Consequences of Drug Abuse and Infections Branch.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

The author(s) reported there is no funding associated with the work featured in this article.

References

  • Narcotics Anonymous World Services. About Us. Na.Org. Published 2023. [accessed 2023 Nov 7]. https://na.org/?ID=aboutus
  • Goncalves RL, Pagano AS, Reis ZSN, Brackstone K, Lopes TCP, Cordeiro SA, Nunes JM, Afagbedzi SK, Head M, Meira Jr W. Usability of telehealth systems for noncommunicable diseases in primary care from the COVID-19 pandemic onward: systematic review. J Med Internet Res. 2023;25:e44209. doi:10.2196/44209. Cited in: PubMed.
  • Biancuzzi H, Mas FD, Bidoli C, Pegoraro V, Zantedeschi M, Negro PA, Campostrini S, Cobianchi L. Economic and performance evaluation of e-health before and after the pandemic era: a literature review and future perspectives. Int J Envir Res & Pub Health. 2023;20:4038. doi: 10.3390/ijerph20054038. Cited in: PubMed.
  • Backhaus A, Agha Z, Maglione ML, Repp A, Ross B, Zuest D, Rice-Thorp NM, Lohr J, Thorp SR. Videoconferencing psychotherapy: a systematic review. Psychol Serv. 2012;9:111–131. doi:10.1037/a0027924. Cited in: PubMed.
  • Kelly JF, Abry A, Ferri M, Humphreys K. Alcoholics anonymous and 12-step facilitation treatments for alcohol use disorder: a distillation of a 2020 Cochrane review for clinicians and policy makers. Alcohol Alcohol. 2020;55:641–651. doi:10.1093/alcalc/agaa050. Cited in: PubMed.
  • Witbrodt J, Mertens J, Kaskutas LA, Bond J, Chi F, Weisner C. Do 12-step meeting attendance trajectories over 9 years predict abstinence? J Subst Abuse Treat. 2012;43:30–43. doi:10.1016/j.jsat.2011.10.004. Cited in: PubMed.
  • Ojeahere MI, Kiburi SK, Agbo P, Kumar R, Jaguga F, Lichtner V. Telehealth interventions for substance use disorders in low- and- middle income countries: a scoping review. PLOS Digit Health. 2022;1:e0000125. doi: 10.1371/journal.pdig.0000125. Cited in: PubMed.
  • Suarez E, Bartholomew TS, Plesons M, Ciraldo K, Ostrer L, Serota DP, Chueng TA, Frederick M, Onugha J, Tookes HE. Adaptation of the tele-harm reduction intervention to promote initiation and retention in buprenorphine treatment among people who inject drugs: a retrospective cohort study. Ann Med. 2023;55:733–743. doi:10.1080/07853890.2023.2182908. Cited in: PubMed.
  • Lin LA, Casteel D, Shigekawa E, Weyrich MS, Roby DH, McMenamin SB. Telemedicine-delivered treatment interventions for substance use disorders: a systematic review. J Subst Abuse Treat. 2019;101:38–49. doi:10.1016/j.jsat.2019.03.007. Cited in: PubMed.
  • Jalali R, Moradi A, Dehghan F, Merzai S, Alikhani M. The exploration of factors related to treatment retention in narcotics anonymous members: a qualitative study. Substance Abuse Treat Prev Policy. 2019;14:14. doi: 10.1186/s13011-019-0205-6. Cited in: PubMed.
  • Galanter M, Josipovic Z, Dermatis H, Weber J, Millard MA. An initial fMRI study on neural correlates of prayer in members of alcoholics anonymous. Am J Drug Alcohol Abuse. 2017;43:44–54. doi:10.3109/00952990.2016.1141912. Cited in: PubMed.
  • Little RJ, Rubin DB. The analysis of social science data with missing values. Sociol Methods Res. 1989;18:292–326. doi: 10.1177/0049124189018002004. Cited in: SageJournals.
  • Blonigen DM, Timko C, Finney JW, Moos BS, Moos RH. Alcoholics anonymous attendance decreases in impulsivity and drinking and psychosocial outcomes over 16 years: moderated-mediation from a developmental perspective. Addiction. 2011;106:2167–77. doi: 10.1111/j.1360-0443.2011.03522.x. Cited in: PubMed.
  • Christo G, Sutton S. Anxiety and self-esteem as a function of abstinence time among recovering addicts attending narcotics anonymous. Br J Clin Psychol. 1994;33:198–200. doi:10.1111/j.2044-8260.1994.tb01111.x. Cited in: PubMed.
  • Gannon K, Pasman E. “Knowing or not knowing”: living as harm reductionists in twelve step recovery. J Subst Use Addict Treat. 2023;145:208954. doi:10.1016/j.josat.2023.208954. Cited in: PubMed.
  • Moos RH. Active ingredients of substance use-focused self-help groups. Addiction. 2008;103:387–396. doi: 10.1111/j.1360-0443.2007.02111.x. Cited in: PubMed.
  • Bowen E, Irish A, Wilding G, LaBarre C, Capozziello N, Nochajski T, Granfield R, Kaskutas LA. Development and psychometric properties of the multidimensional inventory of recovery capital (MIRC). Drug Alcohol Depend. 2023;247:109875. doi:10.1016/j.drugalcdep.2023.109875. Cited in: PubMed.
  • Benedeck S, Hastings OP. Linking individual and collective social capital: operationalization, association, and sociodemographic heterogeneity. Sociol Spect. 2023;43:31–51. doi: 10.1080/02732173.2023.2169214. Cited in: ResearchGate.
  • Steiker L, Macmaster S. Applying a cultural competency framework to twelve step programs. Alcohol Treat Quart. 2005;23:107–20. doi: 10.1300/J020v23n04_08. Cited in: PubMed.
  • Pfund RA, Richards DK, Boness CL, Schwebel FJ, Tonigan JS, Maisto SA, Witkiewitz K. Relative and interactive associations of psychosocial intervention and alcoholics anonymous attendance with alcohol use disorder outcomes. J Stud Alcohol Drugs. 2023;84:281–86. doi: 10.15288/jsad.22-00042. Cited in: PubMed.
  • Kelly JF, Stout RL, Magill M, Tonigan JS, Pagano ME. Mechanisms of behavior change in alcoholics anonymous: does alcoholics anonymous lead to better alcohol use outcomes by reducing depression symptoms? Addiction. 2010;105:626–636. doi: 10.1111/j.1360-0443.2009.02820.x. Cited in: PubMed.
  • Steigerwald F, Stone D. Cognitive restructuring and the 12-step program of alcoholics anonymous. J Subst Abuse Treat. 1999;16:321–327. doi:10.1016/S0740-5472(98)00052-X. Cited in: PubMed.
  • Glassman HS, Moensted ML, Rhodes P, Buus N. Obvious benefits but hidden costs: a critical exploration of the impact of adopting the “master narrative” in alcoholics anonymous. J Subst Use Addict Treat. 2023;148:209010. doi:10.1016/j.josat.2023.209010. Cited in: PubMed.
  • Cao YJ, Chen D, Smith M. Use telehealth as needed: telehealth substitutes in-person primary care and associates with the changes in unplanned events and follow-up visits. BMC Health Serv Res. 2023;23:426. doi:10.1186/s12913-023-09445-0. Cited in: PubMed.
  • Der-Martirosian C, Chu K, Steers WN, Wyte-Lake T, Balut MD, Dobalian A, Heyworth L, Paige NM, Leung L. Examining telehealth use among primary care patients, providers, and clinics during the COVID-19 pandemic. BMC Prim Care. 2022;23:155. doi: 10.1186/s12875-022-01738-3. Cited in: PubMed.
  • Calleja Z, Job J, Jackson C. Offsite primary care providers using telehealth to support a sustainable workforce in rural and remote general practice: a rapid review of the literature. Aust J Rural Health. 2023;31:5–18. doi:10.1111/ajr.12920. Cited in: PubMed.
  • Butler DC, Joshy G, Douglas KA, Sayeed MSB, Welsh J, Douglas A, Korda RJ. ANU telehealth in primary care study team. Changes in general practice use and costs with COVID-19 and telehealth initiatives: analysis of Australian whole-population linked data. Br J Gen Pract. 2023;73. doi:10.3399/BJGP.2022.0351. Cited in: PubMed.
  • Bailey SR, Wyte-Lake T, Lucas J, Williams S, Cantone RE, Garvey BT, Hallock-Koppelman L, Angier H, Cohen DJ. Use of telehealth for opioid use disorder treatment in safety net primary care settings: a mixed-methods study. Subst Use Misuse. 2023;58:1143–1151. doi:10.180/10826084.2023.2212378. Cited in: PubMed.
  • Snoswell CL, Taylor ML, Comans TA, Smith AC, Gray LC, Caffery LJ. Determining if telehealth can reduce health system costs: scoping review. J Med Internet Res. 2020;22:e17298. doi:10.2196/17298. Cited in: PubMed.
  • Walter RJ, Schwab SD, Wilkes M, Yourk D, Zahradka N, Pugmire J, Wolfberg A, Merritt A, Boster J, Loudermilk K, et al. Financial and clinical impact of virtual care during the COVID-19 pandemic: difference-in-differences analysis. J Med Internet Res. 2023;25:e44121. doi:10.2196/44121. Cited in: PubMed.
  • Carter HE, Wallis S, McGowan K, Graves N, Pitt R, Coffey S, Phillips R, Parcell M. Economic evaluation of an integrated virtual care programme for people with chronic illness who are frequent users of health services in Australia. BMJ Open. 2023;13:e066016. doi: 10.1136/bmjopen-2022-066016. Cited in: PubMed.