Agreement between Youth Self-Report and Biospecimen-Confirmed Substance Use: A Systematic Review

Figures & data

Figure 1. PRISMA flow diagram. Abbreviation: PRISMA: preferred reporting items for systematic reviews and meta-analyses.

Table 1. Bias risk assessment ratings.

Study reference	(1) Inclusion criteria	(2) Subject and study description	(3) Exposure description	(4) Measurement of condition	(5) Confounders identified	(6) Confounders addressed	(7) Outcome measurement	(8) Statistical analysis	Sum score
Biological specimen: urine
Akinci et al. (2001)	.5	0	0	.5	.5	.5	0	.5	2.5
Buchan et al. (2002)	.5	0	0	0	0	0	0	0	0.5
Burleson and Kaminer (2006)	0	0	0	.5	.5	.5	0	0	1.5
Ciesla and Spear (2001)	.5	0	.5	0	0	0	0	0	1
Dillon et al. (2005)	.5	0	0	0	0	0	0	0	0.5
Donohue et al. (2007)	0	0	0	0	0	0	0	0	0
Fendrich and Xu (1994)	.5	0	.5	0	0	0	0	0	1
Gignac et al. (2005)	0	0	0	0	1	1	0	.5	2.5
Lennox et al. (2006)	0	0	0	0	1	1	0	0	2
Murphy et al. (2000)	0	0	0	0	.5	0	0	0	0.5
Solbergsdottir et al. (2004)	.5	0	.5	.5	.5	.5	0	0	2.5
Wilcox et al. (2013)	.5	.5	.5	0	0	0	0	0	1.5
Williams and Nowatzki (2005)	.5	0	0	0	1	1	0	0	2.5
Yacoubian (2001)	0	0	0	0	0	0	1	0	1
Yacoubian et al. (2003)	0	0	0	0	0	0	0	0	0
Biological specimen: hair
Bertol et al. (2017)	.5	.5	.5	0	.5	.5	0	0	2.5
Bessa et al. (2010)	0.5	0.5	0	0	1	1	0	0.5	3.5
Magura and Kang (1997)	0.5	0	0.5	0.5	0.5	0.5	0	0	2.5
Palamar et al. (2016)	0.5	0	0.5	0.5	0	0	0	0.5	2
Biological specimen: blood
Caraballo et al. (2004)	.5	0	.5	0	0	0	0	0	1
Biological specimen: saliva
Komro et al. (1993)	.5	.5	0	0	1	1	0.5	1	4.5
Biological specimen: multiple
Comasco et al. (2009)	.5	.5	.5	0	.5	.5	0	0	2.5
Dembo et al. (1999)	.5	0	.5	0	.5	.5	.5	.5	3
Dolcini et al. (2003)	0	.5	.5	0	0	0	0	.5	1.5
Feucht et al. (1994)	.5	0	.5	0	1	1	.5	1	4.5
Junkuy et al. (2014)	.5	0	.5	0	.5	.5	0	.5	2.5
Oesterle et al. (2015)	0	0	.5	0	1	1	0.5	1	4
Mieczkowski et al. (1998)	.5	0	.5	0	0	0	0	1	2

Table 2. Kappa statistics by biospecimen, substance, and self-report period among studies that reported kappa values.

Biospecimen: urine
Substance	Self-report period	Results k (95% CI) ^a	Assay type	Citation
Cannabis	Past 2 days	0.57 (0.37, 0.77)^b	Laboratory confirmed	Murphy et al. (2000)
	Past 3 days	0.45 (0.40, 0.49)	Laboratory confirmed	Fendrich and Xu (1994)
		0.32	Laboratory confirmed	Yacoubian et al. (2003)
	Past 5 days	0.71 (0.50, 0.91)^b	Laboratory confirmed	Murphy et al. (2000)
	Past 7 days	0.79	Drug screen	Wilcox et al. (2013)
		0.69 (0.48, 0.90)^b	Laboratory confirmed	Murphy et al. (2000)
	Past 16 days	0.75	Laboratory confirmed	Solbergsdottir et al. (2004)
	Past 30 days	0.44 (0.33–0.54) 0.31 (0.20–0.41)	Onsite testing Laboratory confirmed	Buchan et al. (2002)
		0.32 (baseline) 0.52 (6 month follow-up) 0.58 (18 month follow-up)	Drug screen	Dillon et al. (2005)
		0.35 (0.31, 0.38)	Laboratory confirmed	Fendrich and Xu (1994)
		0.48	Laboratory confirmed	Williams and Nowatzki (2005)
		0.31^c	Laboratory confirmed	Yacoubian (2001)
	Past 6 months	0.36	Drug screen	Ciesla and Spear (2001)
	Lifetime	0.18 (0.16, 0.20)	Laboratory confirmed	Fendrich and Xu (1994)
Cocaine	Past 2 days	0.73	Laboratory confirmed	Solbergsdottir et al. (2004)
	Past 3 days	0.23 (0.16, 0.29)	Laboratory confirmed	Fendrich and Xu (1994)
		0.18	Laboratory confirmed	Yacoubian et al. (2003)
	Past 7 days	0.75	Drug screen	Wilcox et al. (2013)
	Past 30 days	0.38 (baseline) 0.49 (6 month follow-up) 0.56 (12 month follow-up)	Drug screen	Dillon et al. (2005)
		0.22 (0.16, 0.28)	Laboratory confirmed	Fendrich and Xu (1994)
	Lifetime	0.13 (0.09, 0.18)	Laboratory confirmed	Fendrich and Xu (1994)
Opiates	Past 2 days	0.65	Laboratory confirmed	Solbergsdottir et al. (2004)
	Past 3 days	0.08 (-0.07, 0.22)	Laboratory confirmed	Fendrich and Xu (1994)
		0.40	Laboratory confirmed	Yacoubian et al. (2003)
	Past 4 days	0.30	Laboratory confirmed	Williams and Nowatzki (2005)
	Past 7 days	0.72	Drug screen	Wilcox et al. (2013)
	Past 30 days	0.06 (-0.06, 0.18)	Laboratory confirmed	Fendrich and Xu (1994)
	Lifetime	0.05 (-0.03, 0.12)	Laboratory confirmed	Fendrich and Xu (1994)
Amphetamines/Methamphetamine	Past 2 days	0.83	Laboratory confirmed	Solbergsdottir et al. (2004)
	Past 3 days	0.39 (0.26, 0.52)	Laboratory confirmed	Fendrich and Xu (1994)
	Past 7 days	0.69	Drug screen	Wilcox et al. (2013)
	Past 30 days	0.28 (0.19, 0.37)	Laboratory confirmed	Fendrich and Xu (1994)
	Lifetime	0.14 (0.09, 0.18)	Laboratory confirmed	Fendrich and Xu (1994)
PCP	Past 3 days	0.36 (0.21, 0.51)	Laboratory confirmed	Fendrich and Xu (1994)
		0.46	Laboratory confirmed	Yacoubian et al. (2003)
	Past 30 days	0.37 (0.24, 0.49)	Laboratory confirmed	Fendrich and Xu (1994)
	Lifetime	0.18 (0.11, 0.24)	Laboratory confirmed	Fendrich and Xu (1994)
Alcohol	<24 h	0.13	Laboratory confirmed	Williams and Nowatzki (2005)
	Past 2 days	0.19	Laboratory confirmed	Solbergsdottir et al. (2004)
Benzodiazepines	Past 2 days	0.86	Laboratory confirmed	Solbergsdottir et al. (2004)
	Past 7 days	0.55	Drug screen	Wilcox et al. (2013)
Biospecimen: hair
Alcohol	Past 90 days	0.72 (any use; EtG) 0.66 (any use; FAEE) 0.36 (heavy use; EtG) 0.31 (heavy use; FAEE)	Laboratory confirmed	Bertol et al. (2017)
Caffeine	Past 90 days	0.57 (heavy use)	Laboratory confirmed	Bertol et al. (2017
Cocaine	Past 4 months	0.45 (methadone patients)^d 0.00 (criminal justice)	Laboratory confirmed	Magura and Kang (1997)
Tobacco	Past 90 days	0.40	Laboratory confirmed	Bertol et al. (2017)

Abbreviations: EtG: ethyl glucuronide; FAEE: fatty acid ethyl ester; k: kappa.

^aSome studies did not report a 95% CI, therefore, only kappa is presented.

^bConditional kappa reported only when unconditional kappas were not presented in the study.

^cAverage kappa was calculated across 7 years and 12 sites (kappas ranged from 0.11 to 0.49, SD = 0.09).

^dSelf-report period for comparison depended on hair length (1.3-cm hair segment compared to 4–6 weeks; 3.6-cm segment to past 3–4 months).

Akinci, I. H., Tarter, R. E., & Kirisci, L. (2001). Concordance between verbal report and urine screen of recent marijuana use in adolescents. Addictive Behaviors, 26(4), 613–619. https://doi.org/https://doi.org/10.1016/S0306-4603(00)00146-5

 PubMed Web of Science ®Google Scholar

Buchan, B. J., L. Dennis, M., Tims, F. M., & Diamond, G. S. (2002). Cannabis use: Consistency and validity of self‐report, on‐site urine testing and laboratory testing. Addiction, 97, 98–108.

 Google Scholar

Burleson, J. A., & Kaminer, Y. (2006). Adolescent alcohol and marijuana use: Concordance among objective-, self-, and collateral-reports. Journal of Child & Adolescent Substance Abuse, 16(1), 53–68.

 Google Scholar

Ciesla, J. R., & Spear, S. F. (2001). Concordance of self-reported drug use and qualitative urinalysis in adolescents treated for substance abuse. Clinical Drug Investigation, 21(11), 789–795.

 Google Scholar

Dillon, F. R., Turner, C. W., Robbins, M. S., & Szapocznik, J. (2005). Concordance among biological, interview, and self-report measures of drug use among African American and Hispanic adolescents referred for drug abuse treatment. Psychology of Addictive Behaviors, 19(4), 404.

 Google Scholar

Fendrich, M., & Xu, Y. (1994). The validity of drug use reports from juvenile arrestees. The International Journal of the Addictions, 29(8), 971–985. https://doi.org/https://doi.org/10.3109/10826089409047921

 PubMed Web of Science ®Google Scholar

Gignac, M., Wilens, T. E., Biederman, J., Kwon, A., Mick, E., & Swezey, A. (2005). Assessing cannabis use in adolescents and young adults: What do urine screen and parental report tell you? Journal of Child and Adolescent Psychopharmacology, 15(5), 742–750. https://doi.org/https://doi.org/10.1089/cap.2005.15.742

 PubMed Web of Science ®Google Scholar

Lennox, R., Dennis, M. L., Ives, M., & White, M. K. (2006). The Construct and Predictive Validity of Different Approaches to Combining Urine and Self‐Reported Drug Use Measures among Older Adolescents after Substance Abuse Treatment. The American Journal on Addictions, 15, s92–s101.

 Google Scholar

Murphy, D. A., Durako, S., Muenz, L. R., & Wilson, C. M. (2000). Marijuana use among HIV-positive and high-risk adolescents: A comparison of self-report through audio computerassisted self-administered interviewing and urinalysis. American Journal of Epidemiology, 152(9), 805–813.

 Google Scholar

Solbergsdottir, E., Bjornsson, G., Gudmundsson, L. S., Tyrfingsson, T., & Kristinsson, J. (2004). Validity of self-reports and drug use among young people seeking treatment for substance abuse or dependence. Journal of Addictive Diseases, 23(1), 29–38. https://doi.org/https://doi.org/10.1300/J069v23n01_03

 PubMed Web of Science ®Google Scholar

Wilcox, C. E., Bogenschutz, M. P., Nakazawa, M., & Woody, G. (2013). Concordance between self-report and urine drug screen data in adolescent opioid dependent clinical trial participants. Addictive Behaviors, 38(10), 2568–2574. https://doi.org/https://doi.org/10.1016/j.addbeh.2013.05.015

 PubMed Web of Science ®Google Scholar

Williams, R. J., & Nowatzki, N. (2005). Validity of adolescent self-report of substance use. Substance Use & Misuse, 40(3), 299–311. https://doi.org/https://doi.org/10.1081/ja-200049327

 PubMed Web of Science ®Google Scholar

Yacoubian, G. (2001). Exploring the temporal validity of self-reported marijuana use among juvenile arrestees. Journal of Alcohol and Drug Education, 46(3), 34–42.

 Google Scholar

Yacoubian, G. S., VanderWall, K. L., Johnson, R. J., Urbach, B. J., & Peters, R. J. (2003). Comparing the validity of self-reported recent drug use between adult and juvenile arrestees. Journal of Psychoactive Drugs, 35(2), 279–284. https://doi.org/https://doi.org/10.1080/02791072.2003.10400010

 PubMed Web of Science ®Google Scholar

Bertol, E., Vaiano, F., Boscolo-Berto, R., Fioravanti, A., Palumbo, D., Catalani, V., Mari, F., Patussi, V., & Serpelloni, G. (2017). Alcohol, caffeine, and nicotine consumption in adolescents: Hair analysis versus self-report. The American Journal of Drug and Alcohol Abuse, 43(3), 341–349. https://doi.org/https://doi.org/10.1080/00952990.2016.1216556

 PubMed Web of Science ®Google Scholar

Bessa, M. A., Mitsuhiro, S. S., Chalem, E., Barros, M. M., Guinsburg, R., & Laranjeira, R. (2010). Underreporting of use of cocaine and marijuana during the third trimester of gestation among pregnant adolescents. Addictive Behaviors, 35(3), 266–269. https://doi.org/https://doi.org/10.1016/j.addbeh.2009.10.007

 PubMed Web of Science ®Google Scholar

Magura, S., & Kang, S. Y. (1997). The validity of self-reported cocaine use in two high-risk populations. NIDA Research Monograph, 167, 227–246.

 PubMedGoogle Scholar

Palamar, J. J., Salomone, A., Vincenti, M., & Cleland, C. M. (2016). Detection of “bath salts” and other novel psychoactive substances in hair samples of ecstasy/MDMA/"Molly" users. Drug Alcohol Depend, 161, 200–205. https://doi.org/https://doi.org/10.1016/j.drugalcdep.2016.02.001

 PubMed Web of Science ®Google Scholar

Caraballo, R. S., Giovino, G. A., & Pechacek, T. F. (2004). Self-reported cigarette smoking vs. Serum cotinine among U.S. adolescents. Nicotine & Tobacco Research, 6(1), 19–25. https://doi.org/https://doi.org/10.1080/14622200310001656821

 PubMed Web of Science ®Google Scholar

Komro, K. A., Kelder, S. H., Perry, C. L., & Klepp, K. I. (1993). Effects of a saliva pipeline procedure on adolescent self-reported smoking behavior and youth smoking prevention outcomes. Preventive Medicine, 22(6), 857–865. https://doi.org/https://doi.org/10.1006/pmed.1993.1077

 PubMed Web of Science ®Google Scholar

Comasco, E., Nordquist, N., Leppert, J., Oreland, L., Kronstrand, R., Alling, C., & Nilsson, K. W. (2009). Adolescent alcohol consumption: Biomarkers PEth and FAEE in relation to interview and questionnaire data. Journal of Studies on Alcohol and Drugs, 70(5), 797–804. https://doi.org/https://doi.org/10.15288/jsad.2009.70.797

 PubMed Web of Science ®Google Scholar

Dembo, R., Shemwell, M., Guida, J., Schmeidler, J., Baumgartner, W., Ramirez-Garnica, G., & Seeberger, W. (1999). A comparison of self-report, urine sample, and hair sample testing for drug use: A longitudinal study. In Drug testing technology: Assessment of field applications (1st ed., pp. 91–108). CRC Press.

 Google Scholar

Dolcini, M. M., Adler, N. E., Lee, P., & Bauman, K. E. (2003). An assessment of the validity of adolescent self-reported smoking using three biological indicators. Nicotine & Tobacco Research, 5(4), 473–483.

 PubMed Web of Science ®Google Scholar

Feucht, T. E., Stephens, R. C., & Walker, M. L. (1994). Drug use among juvenile arrestees: A comparison of self-report, urinalysis and hair assay. Journal of Drug Issues, 24(1), 99–116. https://doi.org/https://doi.org/10.1177/002204269402400106

 Web of Science ®Google Scholar

Junkuy, A., Aramrattana, A., & Sribanditmongkol, P. (2014). A comparative study of self-report, urinalysis and hair analysis in the detection of methamphetamine in Yaba users. Journal of the Medical Association of Thailand, 97(7), 776–784.

 PubMedGoogle Scholar

Oesterle, T. S., Hitschfeld, M. J., Lineberry, T. W., & Schneekloth, T. D. (2015). CRAFFT as a substance use screening instrument for adolescent psychiatry admissions. Journal of Psychiatric Practice, 21(4), 259–266. https://doi.org/https://doi.org/10.1097/PRA.0000000000000083

 PubMed Web of Science ®Google Scholar

Mieczkowski, T., Newel, R., & Wraight, B. (1998). Using hair analysis, urinalysis, and self-reports to estimate drug use in a sample of detained juveniles. Substance Use & Misuse, 33(7), 1547–1567. https://doi.org/https://doi.org/10.3109/10826089809069812

 PubMed Web of Science ®Google Scholar