Treatment Services: Triangulation of Methods When There Is No Gold Standard

REFERENCES

• Brown, J. B., & Adams, M. E. (1992). Patients as reliable reporters of medical care process: Recall of ambulatory encounter events. Medical Care 30(5), 400–411.
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20(1), 37–46.
   Web of Science ®Google Scholar
• Cook, R. J. (1998). Kappa and its dependence on marginal rates. In P. Armitage & T. Colton (Eds.), The encyclopedia of biostatistics (pp. 2166–2168). New York: Wiley.
   Google Scholar
• Corser, W., Sikorskii, A., Olomu, A., Stommel, M., Proden, C., & Holmes-Rovner, M. (2008). Concordance between comorbidity data from patient self-report interviews and medical record documentation. BMC Health Services Research 8, 85.
   PubMed Web of Science ®Google Scholar
• Del Boca, F. K., & Noll, J. A. (2000). Truth or consequences: The validity of self-report data in health services research on addictions. Addiction 95(Suppl. 3), S347–S360.
   PubMed Web of Science ®Google Scholar
• Digiusto, E., Seres, V., Bibby, A., & Batey, R. (1996). Concordance between urinalysis results and self-reported drug use by applicants for methadone maintenance in Australia. Addictive Behaviors 21(3), 319–329.
   PubMed Web of Science ®Google Scholar
• Ducharme, L. J., Knudsen, H. K., & Roman, P. M. (2005). Computer systems in addiction treatment programs: Availability and implications for program evaluation. Evaluation and Program Planning 28, 368–378.
   Web of Science ®Google Scholar
• Feinstein, A. R., & Cicchetti, D. V. (1990). High agreement but low kappa: I. The problems of two paradoxes. Journal of Clinical Epidemiology 43(6), 543–549.
   PubMed Web of Science ®Google Scholar
• Fleiss, J. P. (1981). Statistical methods for rates and proportions (2nd ed.). New York: John Wiley.
   Google Scholar
• Gagne, C., White, W., & Anthony, W. A. (2007). Recovery: A common vision for the fields of mental health and addictions. Psychiatric Rehabilitation Journal 31(1), 32–37.
   PubMed Web of Science ®Google Scholar
• Garnick, D. W., Hodgkin, D., & Horgan, C. M. (2002). Selecting data sources for substance abuse services research. Journal of Substance Abuse Treatment 22(1), 11–22.
   PubMed Web of Science ®Google Scholar
• Harlow, S. D., & Linet, M. S. (1989). Agreement between questionnaire data and medical records: The evidence for accuracy of recall. American Journal of Epidemiology 129(2), 233–248.
   PubMed Web of Science ®Google Scholar
• Hillestad, R., Bigelow, J., Bower, A., Girosi, F., Meili, R., Scoville, R., (2005). Can electronic medical record systems transform health care? Potential health benefits, savings, and costs. Health Affairs 24(5), 1103–1117.
   PubMed Web of Science ®Google Scholar
• Jha, A. K., DesRoches, C. M., Campbell, E. G., Donelan, K., Rao, S. R., Ferris, T. G., (2009). Use of electronic health records in U.S. hospitals. New England Journal of Medicine 360(16), 1628–1638.
   PubMed Web of Science ®Google Scholar
• Kashner, T. M. (1998). Agreement between administrative files and written medical records: A case of the Department of Veterans Affairs. Medical Care 36(9), 1324–1336.
   PubMed Web of Science ®Google Scholar
• Killeen, T. K., Brady, K. T., Gold, P. B., Tyson, C., & Simpson, K. N. (2004). Comparison of self-report versus agency records of service utilization in a community sample of individuals with alcohol use disorders. Drug and Alcohol Dependence 73(2), 141–147.
   PubMed Web of Science ®Google Scholar
• Koppel, R. (2009). EMR entry error: Not so benign. AHRQ mortality & morbidity rounds on the web. Retrieved July 16, 2009, from http://www.webmm.ahrq.gov/case.aspx?caseID = 199
   Google Scholar
• Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics 33, 159–174.
   PubMed Web of Science ®Google Scholar
• Langendam, M. W., van Haastrecht, H. J. A., & van Ameijden, E. J. C. (1999). The validity of drug users’ self-reports in a non-treatment setting: Prevalence and predictors of incorrect reporting methadone treatment modalities. International Journal of Epidemiology 28, 514–520.
   PubMed Web of Science ®Google Scholar
• Lloyd-Evans, B., Johnson, S., & Slade, M. (2007). Assessing the content of mental health services: A review of measures. Social Psychiatry and Psychiatric Epidemiology 42(8), 673–682.
   PubMed Web of Science ®Google Scholar
• Luck, J., Peabody, J. W., Dresselhaus, T. R., Lee, M., & Glassman, P. (2000). How well does chart abstraction measure quality? A prospective comparison of standardized patients with the medical record. American Journal of Medicine 108(8), 642–649.
   PubMed Web of Science ®Google Scholar
• Maclure, M., & Willett, W. C. (1987). Misinterpretation and misuse of the kappa statistic. American Journal of Epidemiology 126(2), 161–169.
   PubMed Web of Science ®Google Scholar
• Mant, J., Murphy, M., Rose, P., & Vessey, M. (2000). The accuracy of general practitioner records of smoking and alcohol use: Comparison with patient questionnaires. Journal of Public Health Medicine 22(2), 198–201.
   PubMedGoogle Scholar
• McLellan, A. T., Alterman, A. I., Cacciola, J., Metzger, D., & O’Brien, C. P. (1992). A new measure of substance abuse treatment: Initial studies of the Treatment Services Review. Journal of Nervous and Mental Disease 180(2), 101–110.
   PubMed Web of Science ®Google Scholar
• McLellan, A. T., Carise, D., & Kleber, H. D. (2003). Can the national addiction treatment infrastructure support the public's demand for quality care? Journal of Substance Abuse Treatment 25(2), 117–121.
   PubMed Web of Science ®Google Scholar
• McPhillips-Tangum, C. A., Aubert, R., Bailey, C. M., & Koplan, J. P. (1997). Measuring pediatric immunization status in a managed care organization: Agreement between medical charts and parent telephone interviews. HMO Practice 11(3), 104–110.
   PubMedGoogle Scholar
• Mee-Lee, D., Schulman, G. D., Fishman, M., Gastfriend, D. R., & Griffith, J. H. (Eds.). (2001). ASAM patient placement criteria for the treatment of substance-related disorders (2nd ed. revised). Chevy Chase, MD: American Society of Addiction Medicine.
   Google Scholar
• National Center for Health Statistics. (2006). Electronic medical record use by office-based physicians: United States, 2005. Retrieved July 16, 2009, from www.cdc.gov/nchs/data/hestat/electronic/electronic.htm
   Google Scholar
• Quam, L., Ellis, L. B. M., Venus, P., Clouse, J., Taylor, C. G., & Leatherman, S. (1993). Using claims data for epidemiologic research: The concordance of claims-based criteria for identifying a hypertensive population. Medical Care 31(6), 498–507.
   PubMed Web of Science ®Google Scholar
• Rhodes, A. E., & Fung, K. (2004). Self-reported use of mental health services versus administrative records: Care to recall? International Journal of Methods in Psychiatric Research 13(3), 165–175.
   PubMed Web of Science ®Google Scholar
• Ritter, P. L., Stewart, A. L., Kaymaz, H., Sobel, D. S., Block, D. A., & Lorig, K. R. (2001). Self-reports of health care utilization compared to provider records. Journal of Clinical Epidemiology 54(2), 136–141.
   PubMed Web of Science ®Google Scholar
• Roberts, R. O., Bergstralh, E. J., Schmidt, L., & Jacobsen, S. J. (1996). Comparison of self-reported and medical record health care utilization measures. Journal of Clinical Epidemiology 49(9), 989–995.
   PubMed Web of Science ®Google Scholar
• SAMHSA Office of Applied Studies. (2003a). Alcohol and Drug Services Study (ADSS): Methodology report: Phases I, II and III. Rockville, MD: Substance Abuse and Mental Health Services Administration, Office of Applied Studies. Retrieved from http://www.oas.samhsa.gov/ADSS/ADSSmethods.pdf.
   Google Scholar
• SAMHSA Office of Applied Studies. (2003b). Alcohol and Drug Services Study (ADSS): The national substance abuse treatment system: Facilities, clients, services, and staffing. Rockville, MD: Substance Abuse and Mental Health Services Administration, Office of Applied Studies. Retrieved from http://www.oas.samhsa.gov/ADSS/ADSSorg.pdf.
   Google Scholar
• Spitznagel, E. L., & Helzer, J. E. (1985). A proposed solution to the base rate problem in the kappa statistic. Archives of General Psychiatry 42, 725–728.
   PubMed Web of Science ®Google Scholar
• Stange, K. C., Zyzanski, S. J., Smith, T. F., Kelly, R., Langa, D. M., Flocke, S. A., (1998). How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patients visits. Medical Care 36(6), 851–867.
   PubMed Web of Science ®Google Scholar
• Substance Abuse and Mental Health Services Administration. (2002). Alcohol and Drug Services Study [data files]. Restricted files accessed via SAMHSA, 2001–2002, from www.icpsr.umich.edu
   Google Scholar
• Thompson, B. L., O’Connor, P., Boyle, R., Hindmarsh, M., Salem, N., Simmons, K. W., (2001). Measuring clinical performance: Comparison and validity of telephone survey and administrative data. Health Services Research 36(4), 813–825.
   PubMed Web of Science ®Google Scholar
• Tisnado, D. M., Adams, J. L., Liu, H., Damberg, C. L., Chen, W. P., Hu, F. A., (2006). What is the concordance between the medical record and patient self-report as data sources for ambulatory care? Medical Care 44(2), 132–140.
   PubMed Web of Science ®Google Scholar
• Zanis, D. A., McLellan, A. T., Belding, M., & Moyer, G. (1997). A comparison of three methods of measuring the type and quantity of services provided during substance abuse treatment. Drug and Alcohol Dependence 49, 25–32.
   PubMed Web of Science ®Google Scholar
• Zanis, D. A., McLellan, A. T., & Randall, M. (1994). Can you trust patient self-reports of drug use during treatment? Drug and Alcohol Dependence 35, 127–132.
   PubMed Web of Science ®Google Scholar