A systematic review and meta-analysis of the accuracy of the clock drawing test (CDT) in the identification of delirium in older hospitalised patients

References

• Abawi, M., de Vries, R., Stella, P. R., Agostoni, P., Boelens, D. H. M., van Jaarsveld, R. C., … Emmelot-Vonk, M. H. (2018). Evaluation of cognitive function following transcatheter aortic valve replacement. Heart, Lung and Circulation, 27(12), 1454–1461. doi:10.1016/j.hlc.2017.10.006
   PubMed Web of Science ®Google Scholar
• Abdel Rahman, T. T., Mohammed, M. M., & Saad Aldeen, A. A. (2014). Executive dysfunction in elderly diabetic patients. Geriatrics & Gerontology International, 15(8), 1106. doi:10.1111/ggi.12288
   PubMedGoogle Scholar
• Adamis, D., Meagher, D., O'Neill, D., & McCarthy, G. (2016). The utility of the clock drawing test in detection of delirium in elderly hospitalised patients. Aging & Mental Health, 20(9), 981–986. doi:10.1080/13607863.2015.1050996
   PubMed Web of Science ®Google Scholar
• Adamis, D., Meagher, D., Rooney, S., Mulligan, O., & McCarthy, G. (2018). A comparison of outcomes according to different diagnostic systems for delirium (DSM-5, DSM-IV, CAM, and DRS-R98). International Psychogeriatrics, 30(4), 591–596. doi:10.1017/S1041610217001697
   PubMed Web of Science ®Google Scholar
• Adamis, D., Morrison, C., Treloar, A., Macdonald, A. J., & Martin, F. C. (2005). The performance of the Clock Drawing Test in elderly medical inpatients: Does it have utility in the identification of delirium? Journal of Geriatric Psychiatry and Neurology, 18(3), 129–133. doi:10.1177/0891988705277535
   PubMed Web of Science ®Google Scholar
• Agrell, B., & Dehlin, O. (2012). The clock-drawing test. Age and Ageing, 41(Suppl 3), iii41–45. afs149 [pii] doi:10.1093/ageing/afs149
   PubMedGoogle Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5) (5th ed.). Arlington, VA: American Psychiatric Association.
   Google Scholar
• Blair, M., Kertesz, A., McMonagle, P., Davidson, W., & Bodi, N. (2006). Quantitative and qualitative analyses of clock drawing in frontotemporal dementia and Alzheimer’s disease. Journal of the International Neuropsychological Society, 12(2), 159–165. doi:10.1017/S1355617706060255
   PubMed Web of Science ®Google Scholar
• Brown, L. J., Fordyce, C., & Zaghdani, H. (2011). Detecting deficits of sustained visual attention in delirium. Journal of Neurology, Neurosurgery, and Psychiatry, 82(12), 1340–1344. doi:10.1136/jnnp.2010.208827
   Web of Science ®Google Scholar
• Bryson, G. L., Wyand, A., Wozny, D., Rees, L., Taljaard, M., & Nathan, H. (2011). The clock drawing test is a poor screening tool for postoperative delirium and cognitive dysfunction after aortic repair. Canadian Journal of Anesthesia/Journal Canadien D'anesthésie, 58(3), 267–274. doi:10.1007/s12630-010-9448-4
   PubMed Web of Science ®Google Scholar
• Daly, C., Leonard, M., O'Connell, H., Williams, O., Awan, F., Exton, C., … Meagher, D. J. (2018). Attention, vigilance, and visuospatial function in hospitalized elderly medical patients: Relationship to delirium syndromal status and motor subtype profile. International Psychogeriatrics, 30(4), 493–501. doi:10.1017/S1041610217002174
   PubMed Web of Science ®Google Scholar
• Doebler, P., & Holling, H. (2015). Meta-analysis of diagnostic accuracy with mada. Retrieved from https://cran.rproject.org/web/packages/mada/vignettes/mada.pdf.
   Google Scholar
• Downs, S. H., & Black, N. (1998). The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. Journal of Epidemiology & Community Health, 52(6), 377–384. doi:10.1136/jech.52.6.377
   PubMed Web of Science ®Google Scholar
• Dworkin, A., Lee, D. S., An, A. R., & Goodlin, S. J. (2016). A simple tool to predict development of delirium after elective surgery. Journal of the American Geriatrics Society, 64(11), e149–e153. doi:10.1111/jgs.14428
   PubMed Web of Science ®Google Scholar
• Edwin, N., Peter, J. V., John, G., Eapen, C. E., & Graham, P. L. (2011). Relationship between clock and star drawing and the degree of hepatic encephalopathy. Postgraduate Medical Journal, 87(1031), 605–611. doi:10.1136/pgmj.2010.108985
   PubMed Web of Science ®Google Scholar
• Eeles, E. M. P., Hubbard, R. E., White, S. V., O'Mahony, M. S., Savva, G. M., & Bayer, A. J. (2010). Hospital use, institutionalisation and mortality associated with delirium. Age and Ageing, 39(4), 470–475. doi:10.1093/ageing/afq052
   PubMed Web of Science ®Google Scholar
• Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634. doi:10.1136/bmj.315.7109.629
   PubMed Web of Science ®Google Scholar
• Fisher, B. W., & Flowerdew, G. (1995). A simple model for predicting postoperative delirium in older patients undergoing elective orthopedic surgery. Journal of the American Geriatrics Society, 43(2), 175–178. doi:10.1111/j.1532-5415.1995.tb06385.x
   PubMed Web of Science ®Google Scholar
• Furlaneto, M. E., & Garcez-Leme, L. E. (2006). Delirium in elderly individuals with hip fracture: Causes, incidence, prevalence, and risk factors. Clinics (Sao Paulo), 61(1), 35–40. doi:/S1807-59322006000100007 doi:10.1590/S1807-59322006000100007
   PubMedGoogle Scholar
• Ghanizadeh, A., Safavi, S., & Berk, M. (2013). Clock face drawing test performance in children with ADHD. Basic and Clinical Neuroscience, 4(1), 50–56.
   PubMedGoogle Scholar
• Hazan, E., Zhang, J., Brenkel, M., Shulman, K., & Feinstein, A. (2017). Getting clocked: Screening for TBI-related cognitive impairment with the clock drawing test. Brain Injury, 31(11), 1501–1506. doi:10.1080/02699052.2017.1376763
   PubMed Web of Science ®Google Scholar
• Helmi, L., Meagher, D., O’Mahony, E., O’Neill, D., Mulligan, O., Murthy, S., … Adamis, D. (2016). Agreement and conversion formula between mini-mental state examination and montreal cognitive assessment in an outpatient sample. World Journal of Psychiatry, 6(3), 358–364. doi:10.5498/wjp.v6.i3.358
   PubMed Web of Science ®Google Scholar
• Hozo, S. P., Djulbegovic, B., & Hozo, I. (2005). Estimating the mean and variance from the median, range, and the size of a sample. BMC Medical Research Methodology, 5(1), 13. doi:10.1186/1471-2288-5-13
   PubMedGoogle Scholar
• Huang, H. (2018). Metatron: Meta-analysis for classification data and correction to imperfect reference. R Package Version, 0, 1–1..
   Google Scholar
• Lees, R., Corbet, S., Johnston, C., Moffitt, E., Shaw, G., & Quinn, T. J. (2013). Test accuracy of short screening tests for diagnosis of delirium or cognitive impairment in an acute stroke unit setting. Stroke, 44(11), 3078–3083. STROKEAHA.113.001724 [pii] doi:10.1161/STROKEAHA.113.001724
   PubMed Web of Science ®Google Scholar
• Leonard, M., O'Connell, H., Williams, O., Awan, F., Exton, C., O'Connor, M., … Meagher, D. J. (2016). Attention, vigilance and visuospatial function in hospitalized elderly medical patients: Relationship to neurocognitive diagnosis. Journal of Psychosomatic Research, 90, 84–90. doi:10.1016/j.jpsychores.2016.09.011
   PubMed Web of Science ®Google Scholar
• Lin, J. S., O'Connor, E., Rossom, R. C., Perdue, L. A., & Eckstrom, E. (2013). Screening for cognitive impairment in older adults: A systematic review for the U.S. Preventive Services Task Force. Annals of Internal Medicine, 159(9), 601–612. doi: 1760977 [pii] 10.7326/0003-4819-159-9-201311050-00730
   PubMed Web of Science ®Google Scholar
• Lipowska, M., Czaplewska, E., & Wysocka, A. (2011). Visuospatial deficits of dyslexic children. Medical Science Monitor, 17(4), CR216–221. doi: 881718 [pii] doi:10.12659/MSM.881718
   PubMed Web of Science ®Google Scholar
• Low, Z. Y., Storer, M., Tai, R., & Yates, P. (2019). In-hospital morbidity and mortality among patients from residential respite care. Internal Medicine Journal, 50, 85–91. doi:10.1111/imj.14354
   Web of Science ®Google Scholar
• MacLullich, A. M., Beaglehole, A., Hall, R. J., & Meagher, D. J. (2009). Delirium and long-term cognitive impairment. International Review of Psychiatry, 21(1), 30–42. doi:10.1080/09540260802675031
   PubMed Web of Science ®Google Scholar
• Mattoo, S. K., Grover, S., Chakravarty, K., Trzepacz, P. T., Meagher, D. J., & Gupta, N. (2012). Symptom profile and etiology of delirium in a referral population in Northern India: Factor analysis of the DRS-R98. The Journal of Neuropsychiatry and Clinical Neurosciences, 24(1), 95–101. doi:10.1176/appi.neuropsych.11010009
   PubMed Web of Science ®Google Scholar
• McDowell, I., & Newell, C. (1996). A Guide to rating scales and questionnaires (2nd ed.). Oxford: Oxford University Press.
   Google Scholar
• McInnes, M. D. F., Moher, D., Thombs, B. D., McGrath, T. A., Bossuyt, P. M., Clifford, T., Cohen, J. F., & Willis, B. H., and the PRISMA-DTA Group. (2018). Preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies: The PRISMA-DTA statement. JAMA, 319(4), 388–396. doi:10.1001/jama.2017.19163
   PubMed Web of Science ®Google Scholar
• Mendez, M. F., Ala, T., & Underwood, K. L. (1992). Development of scoring criteria for the clock drawing task in Alzheimer’s disease. Journal of the American Geriatrics Society, 40(11), 1095–1099. doi:10.1111/j.1532-5415.1992.tb01796.x
   PubMed Web of Science ®Google Scholar
• Mittal, C., Gorthi, S. P., & Rohatgi, S. (2010). Early cognitive impairment: Role of clock drawing test. Medical Journal Armed Forces India, 66(1), 25–28. doi:10.1016/S0377-1237(10)80087-5
   PubMedGoogle Scholar
• Nasreddine, Z. S., Phillips, N. A., Bã©Dirian, VéR., Charbonneau, S., Whitehead, V., Collin, I., … Chertkow, H. (2005). The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53(4), 695–699. doi:10.1111/j.1532-5415.2005.53221.x
   PubMed Web of Science ®Google Scholar
• NICE. (2010). Delirium: Diagnosis, prevention and management. London: National Institute for Health and Clinical Excellence, 103.
   Google Scholar
• Nishiwaki, Y., Breeze, E., Smeeth, L., Bulpitt, C. J., Peters, R., & Fletcher, A. E. (2004). Validity of the Clock-Drawing Test as a screening tool for cognitive impairment in the elderly. American Journal of Epidemiology, 160(8), 797–807. doi:10.1093/aje/kwh288
   PubMed Web of Science ®Google Scholar
• O’Caoimh, R., Gao, Y., McGlade, C., Healy, L., Gallagher, P., Timmons, S., & Molloy, D. W. (2012). Comparison of the quick mild cognitive impairment (Qmci) screen and the SMMSE in screening for mild cognitive impairment. Age and Ageing, 41(5), 624–629. doi:10.1093/ageing/afs059
   PubMed Web of Science ®Google Scholar
• O’Hanlon, S., O’Regan, N., Maclullich, A. M., Cullen, W., Dunne, C., Exton, C., & Meagher, D. (2014). Improving delirium care through early intervention: From bench to bedside to boardroom. Journal of Neurology, Neurosurgery, and Psychiatry, 85(2), 207–213. doi:10.1136/jnnp-2012-304334
   PubMed Web of Science ®Google Scholar
• O’Regan, N. A., Maughan, K., Liddy, N., Fitzgerald, J., Adamis, D., Molloy, D. W., … Timmons, S. (2017). Five short screening tests in the detection of prevalent delirium: Diagnostic accuracy and performance in different neurocognitive subgroups. International Journal of Geriatric Psychiatry, 32(12), 1440–1449. doi:10.1002/gps.4633
   PubMed Web of Science ®Google Scholar
• Park, J., Jeong, E., & Seomun, G. (2018). The clock drawing test: A systematic review and meta-analysis of diagnostic accuracy. Journal of Advanced Nursing, 74(12), 2742–2754. doi:10.1111/jan.13810
   PubMed Web of Science ®Google Scholar
• Patocskai, A. T., Pákáski, M., Vincze, G., Fullajtár, M., Szimjanovszki, I., Drótos, G., … Kálmán, J. (2014). Is there any difference between the findings of Clock Drawing Tests if the clocks show different times? Journal of Alzheimer's Disease, 39(4), 749–757. doi:10.3233/JAD-131313
   PubMed Web of Science ®Google Scholar
• Peters, R., & Pinto, E. M. (2008). Predictive value of the Clock Drawing Test. A review of the literature. Dementia and Geriatric Cognitive Disorders, 26(4), 351–355. 000162261 [pii] doi:10.1159/000162261
   PubMed Web of Science ®Google Scholar
• Pinto, E., & Peters, R. (2009). Literature review of the Clock Drawing Test as a tool for cognitive screening. Dementia and Geriatric Cognitive Disorders, 27(3), 201–213. doi:10.1159/000203344
   PubMed Web of Science ®Google Scholar
• Ransing, R. S., Khairkar, P. H., Mishra, K., & Sakekar, G. (2017). Potential bedside utility of the clock-drawing test in evaluating rapid therapeutic response in the natural course of Schizophrenia: A preliminary study. The Journal of Neuropsychiatry and Clinical Neurosciences, 29(3), 289–292. doi:10.1176/appi.neuropsych.16090163
   PubMed Web of Science ®Google Scholar
• Reitsma, J. B., Glas, A. S., Rutjes, A. W., Scholten, R. J., Bossuyt, P. M., & Zwinderman, A. H. (2005). Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. Journal of Clinical Epidemiology, 58(10), 982–990. doi:10.1016/j.jclinepi.2005.02.022
   PubMed Web of Science ®Google Scholar
• Richardson, H. E., & Glass, J. N. (2002). A comparison of scoring protocols on the Clock Drawing Test in relation to ease of use, diagnostic group, and correlations with Mini-Mental State Examination. Journal of the American Geriatrics Society, 50(1), 169–173. doi:10.1046/j.1532-5415.2002.50024.x
   PubMed Web of Science ®Google Scholar
• Rolfson, D. B., McElhaney, J. E., Jhangri, G. S., & Rockwood, K. (1999). Validity of the confusion assessment method in detecting postoperative delirium in the elderly. International Psychogeriatrics, 11(4), 431–438. doi:10.1017/S1041610299006043
   PubMedGoogle Scholar
• Roth, M., Huppert, F. A., Mountjoy, C., & Tym, E. (1998). CAMDEX-R boxed set: the revised Cambridge examination for mental disorders of the elderly. Cambridge: Cambridge University Press.
   Google Scholar
• Rouleau, I., Salmon, D. P., Butters, N., Kennedy, C., & McGuire, K. (1992). Quantitative and qualitative analyses of clock drawings in Alzheimer’s and Huntington’s disease. Brain and Cognition, 18(1), 70–87. doi:10.1016/0278-2626(92)90112-Y
   PubMed Web of Science ®Google Scholar
• Royall, D. R., Cordes, J. A., & Polk, M. (1998). CLOX: An executive clock drawing task. Journal of Neurology, Neurosurgery, and Psychiatry, 64(5), 588–594. doi:10.1136/jnnp.64.5.588
   PubMed Web of Science ®Google Scholar
• Rutjes, A., Reitsma, J., Coomarasamy, A., Khan, K., & Bossuyt, P. (2007). Evaluation of diagnostic tests when there is no gold standard. A review of methods. Health Technology Assessment, 11(50), ix-51. doi:10.3310/hta11500
   Web of Science ®Google Scholar
• Sandyk, R. (1995). Reversal of visuospatial deficit on the Clock Drawing Test in Parkinson’s disease by treatment with weak electromagnetic fields. International Journal of Neuroscience, 82(3–4), 255–268. doi:10.3109/00207459508999805
   PubMed Web of Science ®Google Scholar
• Shulman, K. I. (2000). Clock-drawing: Is it the ideal cognitive screening test? International Journal of Geriatric Psychiatry, 15(6), 548–561. doi:10.1002/1099-1166(200006)15:6<548::AID-GPS242>3.0.CO;2-U
   PubMed Web of Science ®Google Scholar
• Silverman, S. R., Schertz, L. A., Yuen, H. K., Lowman, J. D., & Bickel, C. S. (2012). Systematic review of the methodological quality and outcome measures utilized in exercise interventions for adults with spinal cord injury. Spinal Cord, 50(10), 718–727. doi:10.1038/sc.2012.78
   PubMed Web of Science ®Google Scholar
• Spenciere, B., Alves, H., & Charchat-Fichman, H. (2017). Scoring systems for the Clock Drawing Test: A historical review. Dementia & Neuropsychologia, 11(1), 6–14. doi:10.1590/1980-57642016dn11-010003
   PubMedGoogle Scholar
• Standish, T. I., Molloy, D. W., Bedard, M., Layne, E. C., Murray, E. A., & Strang, D. (1996). Improved reliability of the Standardized Alzheimer’s Disease Assessment Scale (SADAS) compared with the Alzheimer’s Disease Assessment Scale (ADAS). Journal of the American Geriatrics Society, 44(6), 712–716. doi:10.1111/j.1532-5415.1996.tb01838.x
   PubMed Web of Science ®Google Scholar
• Sunderland, T., Hill, J. L., Mellow, A. M., Lawlor, B. A., Gundersheimer, J., Newhouse, P. A., & Grafman, J. H. (1989). Clock drawing in Alzheimer’s disease. A novel measure of dementia severity. Journal of the American Geriatrics Society, 37(8), 725–729. doi:10.1111/j.1532-5415.1989.tb02233.x
   PubMed Web of Science ®Google Scholar
• Tai, S., Xu, L., Zhang, L., Fan, S., & Liang, C. (2015). Preoperative risk factors of postoperative delirium after transurethral prostatectomy for benign prostatic hyperplasia. International Journal of Clinical and Experimental Medicine, 8(3), 4569–4574.
   PubMed Web of Science ®Google Scholar
• Takwoingi, Y., Riley, R. D., & Deeks, J. J. (2015). Meta-analysis of diagnostic accuracy studies in mental health. Evidence Based Mental Health, 18(4), 103–109. doi:10.1136/eb-2015-102228
   PubMed Web of Science ®Google Scholar
• Thalmann, B., Spiegel, R., Stähelin, H. B., Brubacher, D., Ermini-Fünfschilling, D., Bläsi, S., & Monsch, A. U. (2002). Dementia screening in general practice: Optimised scoring for the clock drawing test. Brain Aging, 2(2), 36–43.
   Google Scholar
• Tognoni, P., Simonato, A., Robutti, N., Pisani, M., Cataldi, A., Monacelli, F., … Odetti, P. (2011). Preoperative risk factors for postoperative delirium (POD) after urological surgery in the elderly. Archives of Gerontology and Geriatrics, 52(3), e166–169. doi:10.1016/j.archger.2010.10.021
   PubMed Web of Science ®Google Scholar
• Tranel, D., Rudrauf, D., Vianna, E. P., & Damasio, H. (2008). Does the Clock Drawing Test have focal neuroanatomical correlates? Neuropsychology, 22(5), 553–562. doi:10.1037/0894-4105.22.5.553
   PubMed Web of Science ®Google Scholar
• Tuokko, H., Hadjistavropoulos, T., Rae, S., & O’Rourke, N. (2000). A comparison of alternative approaches to the scoring of clock drawing. Archives of Clinical Neuropsychology, 15(2), 137–148. doi:10.1093/arclin/15.2.137
   PubMed Web of Science ®Google Scholar
• Valenstein, P. N. (1990). Evaluating diagnostic tests with imperfect standards. American Journal of Clinical Pathology, 93(2), 252–258. doi:10.1093/ajcp/93.2.252
   PubMed Web of Science ®Google Scholar
• Vasilian, C. C., Tamasan, S. C., Lungeanu, D., & Poenaru, D. V. (2018). Clock-Drawing Test as a bedside assessment of post-operative delirium risk in elderly patients with accidental hip fracture. World Journal of Surgery, 42(5), 1340–1345. doi:10.1007/s00268-017-4294-y
   PubMed Web of Science ®Google Scholar
• Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. doi:10.18637/jss.v036.i03
   Web of Science ®Google Scholar
• Williams, O. A., O’Connell, H., Leonard, M., Awan, F., White, D., McKenna, F., … Meagher, D. (2017). Development of the four-item Letter and Shape Drawing test (LSD-4): A brief bedside test of visuospatial function. Psychiatry Research, 247, 317–322. doi:10.1016/j.psychres.2016.12.004
   PubMed Web of Science ®Google Scholar
• Witlox, J., Eurelings, L. S., de Jonghe, J. F., Kalisvaart, K. J., Eikelenboom, P., & van Gool, W. A. (2010). Delirium in elderly patients and the risk of postdischarge mortality, institutionalization, and dementia: A meta-analysis. JAMA, 304(4), 443–451. doi: 304/4/443 [pii] doi:10.1001/jama.2010.1013
   PubMed Web of Science ®Google Scholar
• Wolf-Klein, G. P., Silverstone, F. A., Levy, A. P., & Brod, M. S. (1989). Screening for Alzheimer's disease by clock drawing. Journal of the American Geriatrics Society, 37(8), 730–734. doi:10.1111/j.1532-5415.1989.tb02234.x
   PubMed Web of Science ®Google Scholar
• Zuverza-Chavarria, V., & Tsanadis, J. (2011). Measurement properties of the CLOX Executive Clock Drawing Task in an inpatient stroke rehabilitation setting. Rehabil Psychol, 56(2), 138–144. 2011-09991-008 [pii] doi:10.1037/a0023465
   PubMed Web of Science ®Google Scholar