1,283
Views
5
CrossRef citations to date
0
Altmetric
Original Research

Patient characteristics associated with treatment initiation and engagement among individuals diagnosed with alcohol and other drug use disorders in emergency department and primary care settings

, MS, , MA, , PhD, MPH, , MD, MPH, MS, , DrPH, MSW, , PhD, MS, , MD, PhD, , PhD, LMSW, , PhD, MPH, MSW, , PhDORCID Icon, , DrPH, MSW & , PsyD show all

Abstract

Background: Treatment initiation and engagement rates for alcohol and other drug (AOD) use disorders differ depending on where the AOD use disorder was identified. Emergency department (ED) and primary care (PC) are 2 common settings where patients are identified; however, it is unknown whether characteristics of patients who initiate and engage in treatment differ between these settings. Methods: Patients identified with an AOD disorder in ED or PC settings were drawn from a larger study that examined Healthcare Effectiveness Data and Information Set (HEDIS) AOD treatment initiation and engagement measures across 7 health systems using electronic health record data (n = 54,321). Multivariable generalized linear models, with a logit link, clustered on health system, were used to model patient factors associated with initiation and engagement in treatment, between and within each setting. Results: Patients identified in the ED had higher odds of initiating treatment than those identified in PC (adjusted odds ratio [aOR] = 1.89, 95% confidence interval [CI] = 1.73–2.07), with no difference in engagement between the settings. Among those identified in the ED, compared with patients aged 18–29, older patients had higher odds of treatment initiation (age 30–49: aOR = 1.25, 95% CI = 1.12–1.40; age 50–64: aOR = 1.42, 95% CI = 1.26–1.60; age 65+: aOR = 1.27, 95% CI = 1.08–1.49). However, among those identified in PC, compared with patients aged 18–29, older patients were less likely to initiate (age 30–49: aOR = 0.81, 95% CI = 0.71–0.94; age 50–64: aOR = 0.68, 95% CI = 0.58–0.78; age 65+: aOR = 0.47, 95% CI = 0.40–0.56). Women identified in ED had lower odds of initiating treatment (aOR = 0.80, 95% CI = 0.72–0.88), whereas sex was not associated with treatment initiation in PC. In both settings, patients aged 65+ had lower odds of engaging compared with patients aged 18–29 (ED: aOR = 0.61, 95% CI = 0.38–0.98; PC: aOR = 0.42, 95% CI = 0.26–0.68). Conclusion: Initiation and engagement in treatment differed by sex and age depending on identification setting. This information could inform tailoring of future AOD interventions.

Introduction

Alcohol and other drug (AOD) use disorders are highly prevalent in the United States, but patients often go untreated despite many available effective treatments.Citation1–3 Since patients with AOD use disorders have high rates of other medical conditions and injuries,Citation4 general health care settings, including primary care and emergency departments (EDs), provide opportunities to identify individuals with AOD use disorders and encourage entry into treatment.

Performance measures such as the Healthcare Effectiveness Data and Information Set (HEDIS) initiation and engagement measuresCitation5 are intended to measure participation in AOD treatment immediately following a new AOD diagnosis. Treatment engagement has been associated with improved alcohol outcomes,Citation6 better employment outcomes and lower criminal justice involvement among people with past criminal history,Citation7 and reduced mortality among adults receiving care in the Veterans Health Administration (VA).Citation8,Citation9 However, several factors affect treatment initiation and engagement, including patient and clinical characteristics (e.g., sex,Citation10,Citation11 race,Citation12 and type of AOD use disorderCitation13) and facility and health system characteristics (e.g., availability of medications for addiction treatment within the facility where the AOD diagnosis was made and having behavioral medicine specialists or clinical health educators in primary careCitation13). Within health systems, the setting where the AOD diagnosis is identified may also be associated with initiation and engagement in treatment. Patients from integrated health systems diagnosed in AOD specialty treatment settings had higher odds of initiating and engaging in treatment than patients diagnosed in other settings.Citation13 Similarly, VA patients receiving services in AOD specialty clinics advanced from identification to initiation and engagement more often than patients treated in psychiatric or other medical specialties.Citation14 This is likely because once patients have visited a specialty clinic and had an AOD use disorder identified there, they may be more likely to return; the act of moving from another department to specialty treatment demands more motivation from the individual and more action by the referring department.

We recently assessed the proportion of individuals who met HEDIS AOD treatment initiation and engagement criteria across 7 large health systems (see related paper by Weisner et al.Citation15). Performance on both measures revealed significant room for improvement across all sites. The odds of initiating or engaging in treatment differed by patient characteristics, including age, race, and sex, and by setting of identification. ED and primary care were the most common settings for identification of an AOD use disorder; however, both settings had low rates of treatment initiation and engagement. Although the ED and primary care settings both provide unique opportunities to help patients initiate and engage in treatment, correlates of treatment initiation and engagement may differ at the 2 care settings.

This paper examines the characteristics of individuals diagnosed with AOD use disorders in ED and primary care settings to answer the following questions: (1) Do patients identified in the ED differ demographically from those identified in primary care? (2) Which patients are more or less likely to initiate or engage in treatment if they were initially diagnosed in the ED or in primary care? This is an ideal study to evaluate the correlates of initiation and engagement in the 2 care settings for several reasons: (1) our large sample size; (2) the diversity of the health systems membership; (3) patients with AOD use disorders tend to be high utilizers of the EDCitation16; and (4) primary care is a setting where many individuals will be identified because of the recent emphasis on screening.Citation17 Knowing who is more likely to initiate treatment among those identified in the ED and primary care could inform tailoring of AOD interventions in each setting. It could also inform the development or modification of quality metrics to consider adjustment for systems that serve different patient population groups.

Methods

Study participants and data sources

The current study utilizes a subsample of patients from a large multisite study that examined HEDIS AOD treatment initiation and engagement measures across 7 health systems using electronic health record (EHR) data between October 1, 2014, and August 15, 2015.Citation18,Citation19 Following the National Committee for Quality Assurance (NCQA) Measure Technical Specifications, adult patients (age ≥18) with a qualifying AOD use disorder diagnosis who did not have an AOD diagnosis in the 60 days prior were eligible for study inclusion. The current study included patients whose index diagnosis was made in an ED or primary care (e.g., internal medicine, family practice, primary care, obstetrics and gynecology [OB/GYN], urgent care) setting. This research was reviewed and approved by the Kaiser Permanente Northern California Institutional Review Board. This study met requirements for a waiver of informed consent.

Measures

Patient-level characteristics

The index diagnosis date, diagnosis (classified as alcohol use disorder, cannabis use disorder, opioid use disorder, or other drug use disorder [including amphetamine, cocaine, hallucinogen, sedative, unspecified]), and setting (ED or primary care) of diagnosis were identified. Demographic data (age, sex, and race/ethnicity) were extracted from the EHR; insurance type (commercial/private, Medicare, state subsidized [including Medicaid], unknown) was available for 6 of the 7 participating health systems and thus is reported in descriptive tables but was excluded from statistical models. To examine the cumulative burden of medical comorbidity, Charlson-Deyo comorbidity index score was calculated for all patients based on ICD-9 (International Classification of Diseases Ninth Revision) diagnosis codes made in the year prior to the index date.Citation20 The Charlson-Deyo is a weighted score of 17 conditions predicting 1-year mortality risk. Each condition is assigned a score of 1, 2, 3, or 6, depending on the associated risk of dying. Scores are summed to create a total score where a higher score indicates higher mortality risk.

Outcomes

Consistent with HEDIS definitions,Citation18,Citation19 patients were required to have a subsequent AOD service (not including an ED visit or detoxification) within 14 days of the index episode to be considered “initiated.” Patients who had 2 or more AOD-related services within 30 days after initiating treatment were considered “engaged” in treatment.

Analysis

Chi-square tests and analysis of variance (ANOVA) models were used to examine differences in categorical and continuous measures, respectively, by index setting (ED versus primary care). As patients were nested within health systems, generalized linear models (GLMs), with a logit link, clustered on health system, were used to model patient factors associated with initiation of treatment and engagement. Treatment initiation was examined among all patients identified, whereas treatment engagement was examined only among those who initiated treatment. Initial models compared initiation and engagement rates directly between settings. The sample was then stratified by setting to examine associations between patient characteristics and treatment initiation and engagement within each setting. All models included age, sex, race/ethnicity, Charlson-Deyo comorbidity score, and index diagnosis type. Statistical significance was measured at P < .05.

Results

Patient characteristics

Among all patients included in the parent study with a qualifying AOD diagnosis during the study period (N = 86,565), 26.1% (22,553) were identified in ED and 36.7% (31,768) were identified in primary care; all of these patients were included in the present analyses (n = 54,321). Fewer women (42.1% ED versus 36.2% primary care; P < .001), younger patients aged 18–29 (35.6% ED versus 15.7% primary care; P < .001), and black/African Americans (11.5% ED versus 8.7% primary care; P < .001) were identified with an AOD disorder in the ED compared with primary care. More patients identified in the ED also had commercial or private pay insurance (68.7% ED versus 58.8% primary care; P < .001). Level of medical comorbidity (per the Charlson-Deyo comorbidity score) did not differ between the 2 groups. Among all diagnoses made, opioid use disorder diagnoses occurred more frequently in the ED (5.8%) than in primary care (16.2%), whereas cannabis use disorder (16.9% ED versus 12.6% primary care) and other drug use disorder diagnoses (21.1% ED versus 16.1% primary care; P < .001) occurred more often in the ED; identification rates for alcohol use disorder were similar across settings (55.8% ED versus 55.1% primary care; see ).

Table 1. Patient characteristics associated with an alcohol or drug use disorder diagnosis index encounter in October 1, 2014, to August 15, 2015, across 7 health systems by index encounter setting (n = 54,321).

Treatment initiation

Patients identified in the ED had higher odds of initiating treatment than those identified in primary care (adjusted odds ratio [aOR] = 1.89, 95% confidence interval [CI] = 1.73–2.07; ). Among those identified in the ED (n = 22,553), 12.2% (n = 2,749/22,553) initiated treatment. Compared with patients aged 18–29, older patients had higher odds of treatment initiation (age 30–49: aOR = 1.25, 95% CI = 1.12–1.40; age 50–64: aOR = 1.42, 95% CI = 1.26–1.60; age 65+: aOR = 1.27, 95% CI = 1.08–1.49). Patients with an index opioid use disorder diagnosis (aOR = 1.31, 95% CI = 1.10–1.56) or other drug use disorder diagnosis (aOR = 1.20, 95% CI = 1.08–1.33) had higher odds of treatment initiation compared with those with an alcohol use disorder. Women (aOR = 0.80, 95% CI = 0.72–0.88), and patients with a cannabis use disorder index diagnosis compared with alcohol use disorder (aOR = 0.69, 95% CI = 0.60–0.80), had lower odds of treatment initiation when identified in the ED. Asians (aOR = 0.74, 95% CI = 0.59–0.91), black/African Americans (aOR = 0.70, 95% CI = 0.60–0.81), Hispanics (aOR = 0.69, 95% CI = 0.61–0.78), and other/unknown race/ethnicities had lower odds of initiation than whites. The Charlson-Deyo score was not significantly associated with initiation among patients identified in ED.

Table 2. Patient characteristics associated with treatment initiation and engagement* among all patients identified with an alcohol or other drug use disorder in an emergency department or primary care setting.

Among patients identified in primary care (n = 31,768), 7.3% (n = 2,312/31,768) initiated treatment. Compared with patients aged 18–29, older patients were less likely to initiate treatment (age 30–49: aOR = 0.81, 95% CI = 0.71–0.94; age 50–64: aOR = 0.68, 95% CI = 0.58–0.78; age 65+: aOR = 0.47, 95% CI = 0.40–0.56); there were no differences by sex. Patients with greater medical comorbidity (higher Charlson-Deyo score: aOR = 1.04, 95% CI = 1.01–1.08), or an opioid use disorder compared with those with an alcohol use disorder (aOR = 1.14, 95% CI = 1.00–1.29), were more likely to initiate treatment. Hispanics compared with whites (aOR = 0.84, 95% CI = 0.74–0.95), and patients with a cannabis use disorder compared with alcohol use disorder index diagnosis (aOR = 0.34, 95% CI = 0.33–0.43), were less likely to initiate treatment ().

Table 3. Patient characteristics associated with treatment initiation by alcohol or drug abuse/dependence diagnosis index encounter setting.

Treatment engagement

Treatment engagement did not differ between index diagnosis settings (aOR = 0.81, 95% CI = 0.65–1.00; ). Among patients identified in the ED who initiated treatment (n = 2,749), 15.2% (n = 419/2,749) also engaged in treatment. Patients with opioid use disorder were more likely to engage than those with alcohol use disorder (aOR = 1.76, 95% CI = 1.20–2.57). Patients aged 65+ compared with patients aged 18–29 (aOR = 0.61, 95% CI = 0.38–0.98), black/African Americans compared with whites (aOR = 0.53, 95% CI = 0.32–0.87), and patients with more medical comorbidity (aOR = 0.87, 95% CI = 0.79–0.95) had lower odds of engagement. Patients with a cannabis use disorder (aOR = 0.39, 95% CI = 0.24–0.65) or other drug use index diagnosis (aOR = 0.65, 95% CI = 0.48–0.88) also had lower odds of engaging in treatment compared with patients with an alcohol use disorder.

Among patients identified in primary care who initiated treatment (n = 2,312), 19.4% (n = 448/2,312) engaged. Patients with an opioid use disorder had higher odds of engagement compared with those with an alcohol use disorder (aOR = 1.36, 95% CI = 1.01–1.83). Patients aged 65+ (aOR = 0.42, 95% CI = 0.26–0.68) compared with patients aged 18–29, black/African Americans (aOR = 0.60, 95% CI = 0.36–0.99) compared with white patients, and those with higher medical comorbidity (aOR = 0.91, 95% CI = 0.82–1.00) had lower odds of engagement ().

Table 4. Patient characteristics associated with treatment engagement* by alcohol or drug abuse/dependence diagnosis index encounter setting.

Discussion

We examined characteristics of individuals diagnosed with AOD use disorders in the ED and primary care settings to identify demographic differences related to AOD treatment initiation and engagement. Among patients identified in the ED, older patients were more likely to initiate. The opposite was true among patients identified in primary care, with younger patients being more likely to initiate. Race/ethnicity was more strongly associated with initiation in the ED setting, whereas medical comorbidities were more strongly associated in the primary care setting. Factors associated with engagement were similar in both settings.

Regardless of setting, there was a higher prevalence of AOD use disorders among men. A higher proportion of women with AOD use disorders were identified in the ED. However, when women were identified in the ED, they were less likely to initiate treatment than men, although this was not true in the primary care setting. Importantly, once patients initiated treatment, rates of engagement in treatment do not appear to differ by sex in either setting.

The ED was also an important setting for identifying AOD use disorders among young adults. The absolute number of young adults identified in the ED was 60% higher than the number identified in primary care, and the proportion identified in the ED, compared with primary care, was twice the rate. Young adults identified in the ED had lower odds of initiating treatment than older adults, but higher odds when identified in primary care. These differences in initiation may be due to the reasons that young and older individuals access ED versus primary care, which is outside the scope of this study, but which warrants further research. Importantly, after initiating treatment, young adults identified in either setting were as likely as their older counterparts to engage in treatment.

The reverse pattern was found for older adults (≥50 years). More older adults were identified in primary care than in the ED. However, older adults identified in primary care were less likely to initiate or engage in subsequent treatment. It may be that primary care clinicians are more likely to screen older adults than younger adults in their practices; however, it is also likely that older patients have more frequent primary care visits, providing more opportunities for providers to screen for AOD use disorders and discuss their concerns. Clinicians may also be less likely to follow up on positive AOD screens with older patients, or older patients may be less likely to follow up on primary care provider recommendations for AOD treatment due to competing health needs. When an AOD use disorder is identified in the ED, older patients were more likely to initiate. An ED visit that results in an AOD use disorder diagnosis may be more compelling for eliciting follow through for these patients, whereas a primary care visit may be more focused on a specific health condition that the patient does not feel is related to an AOD problem. In both settings, older patients were less likely to engage than younger patients. Future research should focus on reasons for lack of engagement among this oldest group, and how engagement interventions can be tailored to maintain this group of patients in ongoing care.

More individuals were identified with opioid use disorder in primary care than in the ED. Individuals with a cannabis use disorder were identified in both settings in about equal numbers, but there were fewer patients with opioid use disorder and cannabis use disorder in both settings than patients with alcohol use disorder. Individuals identified with cannabis use disorder had lower odds of initiating and engaging in treatment than individuals with alcohol use disorder, regardless of setting. This could be because many patients with cannabis use disorders, and possibly their providers as well, do not consider their use to be problematic. Conversely, individuals identified with opioid use disorder, in either setting, had higher odds of initiating and engaging in treatment than individuals with alcohol use disorders. Increased attention to the opioid use disorder crisis, resulting in lost access to opioids, may be increasing its identification and patient willingness to initiate treatment.

There are several limitations to this EHR-based, multisite health system study. Insurance type was only available for 6 of the 7 participating health systems and thus was not included in the models, making it unclear if socioeconomic status, for which insurance type can act as a proxy, is related to initiation and engagement. There was some variation in the coding of the department variable across sites, and at one site enrollment was based on utilization; however, this conservative definition is unlikely to impact the results. Identification of initiation or engagement was based on ICD-9 diagnosis codes of AOD use disorders; therefore, patients identified with a concern but not given a diagnosis would have been missed. Identification in these 2 settings could be low given that these providers are not clinicians with specialized AOD use disorder knowledge relative to identification in specialty clinics. We were unable to examine reasons for ED visits in this study, and there may be differences in the severity or types of events that lead to ED visits (and related AOD use disorder diagnoses) for men and women, as well as for different age groups. Future research should examine differences in reasons for ED visits, and reasons for avoiding or initiating AOD treatment following an ED visit, in order to develop tailored interventions. With the increase in implementation of screening, brief intervention, and referral to treatment (SBIRT) in health systems, primary care will also likely be an even more important setting for such interventions.

Conclusion

Patients have diverse motivations for, and barriers to, entering AOD treatment, and perhaps even divergent responses to different circumstances depending on whether their AOD disorder was identified in the ED or primary care. Patient characteristics associated with AOD treatment initiation differed between primary care and ED settings, whereas those associated with treatment engagement did not. Based on these study findings, although there is still a need for broad screening in both settings, it may be beneficial for clinicians in the ED setting to focus extra attention on younger patients and nonwhite race/ethnicities, whereas clinicians in primary care settings may need to spend extra time with older patients and those with a medical comorbidity, to encourage treatment initiation among these groups. Rates of initiation and engagement are still low in both settings, however, and more emphasis should be placed on connecting all patients to treatment as needed. As the ED and primary care settings are often the first line of care for patients struggling with an AOD use disorder, addressing patients’ needs in these settings as they are identified may help them access and engage in treatment.

Acknowledgments

We thank Andrea Altschuler and Agatha Hinman at Kaiser Permanente Northern California and Richard Contreras at Kaiser Permanente Southern California for their contributions.

Additional information

Funding

This study was supported by a grant from the National Institute of Drug Abuse (NIDA) 3UG1DA040314-02S2. The content is solely the responsibility of the authors and does not necessarily represent the official views of NIDA. The NIDA Clinical Trials Network (CTN) Research Development Committee reviewed the study protocol and the NIDA CTN publications committee reviewed and approved the manuscript for publication. The funding organization had no role in the collection, management, analysis, and interpretation of the data or decision to submit the manuscript for publication.

Notes on contributors

Andrea H. Kline-Simon

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Scott P. Stumbo

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Cynthia I. Campbell

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Ingrid A. Binswanger

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Constance Weisner

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Irina V. Haller

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Rulin C. Hechter

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Brian K. Ahmedani

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Gwen T. Lapham

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Amy M. Loree

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Stacy A. Sterling

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

Bobbi Jo H. Yarborough

A.H.K.-S. conducted the analysis and drafted the manuscript. S.P.S., C.W., and B.J.Y. participated in drafting the manuscript. All other coauthors have provided scientific critiques and comments and reviewed and approved the final manuscript. All authors attest they meet the ICMJE criteria for authorship and agree to be accountable for all aspects of the work.

References

  • U.S. Department of Health and Human Services and Office of the Surgeon General. Facing Addiction in America: The Surgeon General’s Report on Alcohol, Drugs, and Health. Washington, DC: U.S. Department of Health & Human Services; 2016.
  • Center for Behavioral Health Statistics and Quality. Results from the 2015 National Survey on Drug Use and Health: Detailed Tables. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2016.
  • McLellan AT, Lewis DC, O'Brien CP, Kleber HD. Drug dependence, a chronic medical illness: implications for treatment, insurance, and outcomes evaluation. JAMA. 2000;284(13):1689–1695.
  • Mertens JR, Lu YW, Parthasarathy S, Moore C, Weisner CM. Medical and psychiatric conditions of alcohol and drug treatment patients in an HMO: comparison with matched controls. Arch Intern Med. 2003;163(20):2511–2517.
  • National Committee for Quality Assurance. HEDIS 2015 QRS Technical Update. Washington (DC): National Committee for Quality Assurance (NCQA); October 1, 2014. http://www.ncqa.org/Portals/0/HEDISQM/Hedis2015/HEDIS%20QRS%202015%20Technical%20Update_Final.pdf. Accessed July 26, 2018.
  • Harris AH, Humphreys K, Bowe T, Tiet Q, Finney JW. Does meeting the HEDIS substance abuse treatment engagement criterion predict patient outcomes? J Behav Health Serv Res. 2010;37(1):25–39.
  • Dunigan R, Acevedo A, Campbell K, et al. Engagement in outpatient substance abuse treatment and employment outcomes. J Behav Health Serv Res. 2014;41(1):20–36.
  • Watkins KE, Paddock SM, Hudson TJ, et al. Association between quality measures and mortality in individuals with co-occurring mental health and substance use disorders. J Subst Abuse Treat. 2016;69:1–8.
  • Paddock SM, Hepner KA, Hudson T, et al. Association between process-based quality indicators and mortality for patients with substance use disorders. J Stud Alcohol Drugs. 2017;78(4):588–596.
  • Choi S, Adams SM, Morse SA, MacMaster S. Gender differences in treatment retention among individuals with co-occurring substance abuse and mental health disorders. Subst. Use Misuse. 2015;50(5):653–663.
  • Greenfield SF, Brooks AJ, Gordon SM, et al. Substance abuse treatment entry, retention, and outcome in women: a review of the literature. Drug Alcohol Depend. 2007;86(1):1–21.
  • Bensley KM, Harris AH, Gupta S, et al. Racial/ethnic differences in initiation of and engagement with addictions treatment among patients with alcohol use disorders in the veterans health administration. J Subst Abuse Treat. 2017;73:27–34.
  • Yarborough BJH, Chi FW, Green CA, Hinman A, Mertens J, Beck A, Horberg M, Weisner C, Campbell CI. (2018). Patient and system characteristics associated with performance on the HEDIS measures of Alcohol and Other Drug Treatment Initiation and Engagement. J Addict Med 12(4):278–286. doi:10.1097/ADM.0000000000000399
  • Harris AH, Bowe T, Finney JW, Humphreys K. HEDIS initiation and engagement quality measures of substance use disorder care: impact of setting and health care specialty. Popul Health Manag. 2009;12(4):191–196.
  • Weisner C, Campbell CI, Altschuler A, et al. Factors associated with Healthcare Effectiveness Data and Information Set (HEDIS) Alcohol and Other Drug (AOD) measure performance in 2014-2015. Subst Abus. under review.
  • Crane EH. The CBHSQ Report: Highlights of the 2011 Drug Abuse Warning Network (DAWN) Findings on Drug-Related Emergency Department Visits. Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration; 2013. https://www.ncbi.nlm.nih.gov/books/NBK384680/pdf/Bookshelf_NBK384680.pdf. Accessed July 26, 2018.
  • Mertens JR, Chi FW, Weisner CM, et al. Physician versus non-physician delivery of alcohol screening, brief intervention and referral to treatment in adult primary care: the ADVISe cluster randomized controlled implementation trial. Addict Sci Clin Pract. 2015;10(26):26.
  • National Committee for Quality Assurance. Summary table of measures, product lines and changes. HEDIS. 2015;2:8. http://www.ncqa.org/Portals/0/HEDISQM/Hedis2015/List_of_HEDIS_2015_Measures.pdf. Accessed July 26, 2018.
  • Agency for Healthcare Research and Quality. Guidelines and measures. 2018. https://www.ahrq.gov/gam/index.html. Accessed July 26, 2018.
  • Charlson ME, Charlson RE, Peterson JC, Marinopoulos SS, Briggs WM, Hollenberg JP. The Charlson comorbidity index is adapted to predict costs of chronic disease in primary care patients. J Clin Epidemiol. 2008;61(12):1234–1240.