Comparing the Oxford Digital Multiple Errands Test (OxMET) to a real-life version: Convergence, feasibility, and acceptability

References

• Alderman, N., Burgess, P. W., Knight, C., & Henman, C. (2003). Ecological validity of a simplified version of the multiple errands shopping test. Journal of the International Neuropsychological Society, 9(1), 31–44. https://doi.org/10.1017/S1355617703910046
   PubMed Web of Science ®Google Scholar
• Ambrens, M., van Schooten, K. S., Lung, T., Clemson, L., Close, J. C. T., Howard, K., Lord, S. R., Zijlstra, G. A. R., Tiedemann, A., Valenzuela, T., Vandelanotte, C., Chow, J., McInerney, G., Miles, L., Woodbury, A., & Delbaere, K. (2022). Economic evaluation of the e-health StandingTall balance exercise programme for fall prevention in people aged 70 years and over. Age and Ageing, 51(6), afac130. https://doi.org/10.1093/ageing/afac130
   PubMed Web of Science ®Google Scholar
• Antoniak, K., Clores, J., Jensen, D., Nalder, E., Rotenberg, S., & Dawson, D. R. (2019). Developing and validating a big-store multiple errands test. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02575
   PubMed Web of Science ®Google Scholar
• Basagni, B., Bosetti, S., Cantelli, S., Ermon, S., Rovere, F., Navarrete, E., De Tanti, A., & Saviola, D. (2021). Development of a generic version of the multiple errands test for severe acquired brain injuries. Applied Neuropsychology: Adult, 0(0), 1–8. https://doi.org/10.1080/23279095.2021.1990928
   Google Scholar
• Bradshaw, C., Atkinson, S., & Doody, O. (2017). Employing a qualitative description approach in health care research. Global Qualitative Nursing Research, 4, 2333393617742282. https://doi.org/10.1177/2333393617742282
   Web of Science ®Google Scholar
• Broderick, J. P., Adeoye, O., & Elm, J. (2017). Evolution of the modified Rankin scale and its use in future stroke trials. Stroke, 48(7), 2007–2012. https://doi.org/10.1161/STROKEAHA.117.017866
   PubMed Web of Science ®Google Scholar
• Brumfitt, S. M., & Sheeran, P. (1999). The development and validation of the visual analogue self-esteem scale (VASES) 1. British Journal of Clinical Psychology, 38(4), 387–400. https://doi.org/10.1348/014466599162980
   PubMed Web of Science ®Google Scholar
• Burns, S. P., Dawson, D. R., Perea, J. D., Vas, A., Pickens, N. D., & Neville, M. (2019). Development, reliability, and validity of the multiple errands test home version (MET–home) in adults with stroke. American Journal of Occupational Therapy, 73(3), 7303205030p1–7303205030p10. https://doi.org/10.5014/ajot.2019.027755
   PubMed Web of Science ®Google Scholar
• Cipresso, P., Albani, G., Serino, S., Pedroli, E., Pallavicini, F., Mauro, A., & Riva, G. (2014). Virtual multiple errands test (VMET): A virtual reality-based tool to detect early executive functions deficit in Parkinson’s disease. Frontiers in Behavioral Neuroscience, 8, 405. https://doi.org/10.3389/fnbeh.2014.00405
   PubMed Web of Science ®Google Scholar
• Clark, A. J., Anderson, N. D., Nalder, E., Arshad, S., & Dawson, D. R. (2017). Reliability and construct validity of a revised Baycrest Multiple Errands Test. Neuropsychological Rehabilitation, 27(5), 667–684. https://doi.org/10.1080/09602011.2015.1117981
   PubMed Web of Science ®Google Scholar
• Cuberos-Urbano, G., Caracuel, A., Vilar-López, R., Valls-Serrano, C., Bateman, A., & Verdejo-García, A. (2013). Ecological validity of the multiple errands test using predictive models of dysexecutive problems in everyday life. Journal of Clinical and Experimental Neuropsychology, 35(3), 329–336. https://doi.org/10.1080/13803395.2013.776011
   PubMed Web of Science ®Google Scholar
• Davis, J. C., Robertson, M. C., Ashe, M. C., Liu-Ambrose, T., Khan, K. M., & Marra, C. A. (2010). International comparison of cost of falls in older adults living in the community: A systematic review. Osteoporosis International, 21(8), 1295–1306. https://doi.org/10.1007/s00198-009-1162-0
   PubMed Web of Science ®Google Scholar
• Demeyere, N., Haupt, M., Webb, S. S., Strobel, L., Milosevich, E., Moore, M. J., Wright, H., Finke, K., & Duta, M. (2021). Introducing the tablet-based Oxford cognitive screen-plus (OCS-plus) as an assessment tool for subtle cognitive impairments. Scientific Reports, 11(8000). https://doi.org/10.1038/s41598-021-87287-8
   PubMedGoogle Scholar
• Gagnier, J. J., Lai, J., Mokkink, L. B., & Terwee, C. B. (2021). COSMIN reporting guideline for studies on measurement properties of patient-reported outcome measures. Quality of Life Research, 30(8), 2197–2218. https://doi.org/10.1007/s11136-021-02822-4
   PubMed Web of Science ®Google Scholar
• Goldstein, S., Naglieri, J. A., Princiotta, D., & Otero, T. M. (2014). Introduction: A history of executive functioning as a theoretical and clinical construct. In Goldstein S. & Naglieri J.A. (Eds.), Handbook of executive functioning (pp. 3–12). Springer.
   Google Scholar
• Green, S. L., Gignac, G. E., Watson, P. A., Brosnan, N., Becerra, R., Pestell, C., & Weinborn, M. (2021). Apathy and depression as predictors of activities of daily living following stroke and traumatic brain injuries in adults: A meta-analysis. Neuropsychology Review, 1–19. https://doi.org/10.1007/s11065-021-09501-8
   Web of Science ®Google Scholar
• Harwood, R. H., & Ebrahim, S. (2002). The validity, reliability and responsiveness of the Nottingham extended activities of daily living scale in patients undergoing total hip replacement. Disability and Rehabilitation, 24(7), 371–377. https://doi.org/10.1080/09638280110101541
   PubMed Web of Science ®Google Scholar
• Hynes, S. M., Fish, J., Evans, J. J., & Manly, T. (2015). Developing a computerised multiple elements test for organisational difficulties. International Journal of Developmental Science, 9(2), 85–94. https://doi.org/10.3233/DEV-140157
   Google Scholar
• Josman, N., Kizony, R., Hof, E., Goldenberg, K., Weiss, P. L., & Klinger, E. (2014). Using the virtual action planning-supermarket for evaluating executive functions in people with stroke. Journal of Stroke and Cerebrovascular Diseases, 23(5), 879–887. https://doi.org/10.1016/j.jstrokecerebrovasdis.2013.07.013
   PubMed Web of Science ®Google Scholar
• Jovanovski, D., Zakzanis, K., Campbell, Z., Erb, S., & Nussbaum, D. (2012). Development of a novel, ecologically oriented virtual reality measure of executive function: The multitasking in the city test. Applied Neuropsychology: Adult, 19(3), 171–182. https://doi.org/10.1080/09084282.2011.643955
   PubMed Web of Science ®Google Scholar
• Juslin, P., & Olsson, H. (2005). Capacity limitations and the detection of correlations: Comment on kareev (2000). Psychological Review, 112(1), 256–267; discussion 280. https://doi.org/10.1037/0033-295X.112.1.256
   PubMed Web of Science ®Google Scholar
• Kannan, L., Vora, J., Bhatt, T., & Hughes, S. L. (2019). Cognitive-motor exergaming for reducing fall risk in people with chronic stroke: A randomized controlled trial. NeuroRehabilitation, 44(4), 493–510. https://doi.org/10.3233/NRE-182683
   PubMed Web of Science ®Google Scholar
• Knight, C., Alderman, N., & Burgess, P. W. (2002). Development of a simplified version of the multiple errands test for use in hospital settings. Neuropsychological Rehabilitation, 12(3), 231–255. https://doi.org/10.1080/09602010244000039
   Web of Science ®Google Scholar
• Knight, R. G., McMahon, J., Green, T. J., & Skeaff, C. M. (2004). Some normative and psychometric data for the geriatric depression scale and the cognitive failures questionnaire from a sample of healthy older persons. New Zealand Journal of Psychology, 33(3), 163–170.
   Web of Science ®Google Scholar
• Koren, Y., Rozenfeld, E., Elefant, I., Khir, N., Glassberg, E., & Batcir, S. (2022). Does cognitive loading interfere with walking control? Gait & Posture, 96, 185–189. https://doi.org/10.1016/j.gaitpost.2022.05.032
   PubMed Web of Science ®Google Scholar
• Laakso, H. M., Hietanen, M., Melkas, S., Sibolt, G., Curtze, S., Virta, M., Ylikoski, R., Pohjasvaara, T., Kaste, M., Erkinjuntti, T., & Jokinen, H. (2019). Executive function subdomains are associated with post-stroke functional outcome and permanent institutionalization. European Journal of Neurology, 26(3), 546–552. https://doi.org/10.1111/ene.13854
   PubMed Web of Science ®Google Scholar
• Maeir, A., Krauss, S., & Katz, N. (2011). Ecological validity of the multiple errands test (MET) on discharge from neurorehabilitation hospital. OTJR: Occupation, Participation and Health, 31(1_suppl), S38–S46. https://doi.org/10.3928/15394492-20101108-07
   PubMedGoogle Scholar
• Mahoney, F., & Barthel, D. W. (1965). Functional evaluation ; the Barthel index. A simple index of the independence useful in scoring improvement in the rehabilitation of the chronically ill. Maryland State Medical Journal, 14, 61–65.
   PubMedGoogle Scholar
• Miyake, A., Emerson, M. J., & Friedman, N. P. (2000). Assessment of executive functions in clinical settings: Problems and recommendations. Seminars in Speech and Language, 21 (2), 169–183. https://doi.org/10.1055/s-2000-7563
   PubMedGoogle Scholar
• Mole, J. A., & Demeyere, N. (2020). The relationship between early post-stroke cognition and longer term activities and participation: A systematic review. Neuropsychological Rehabilitation, 30(2), 346–370. https://doi.org/10.1080/09602011.2018.1464934
   PubMed Web of Science ®Google Scholar
• Moore, M. J., Vancleef, K., Riddoch, M. J., Gillebert, C. R., & Demeyere, N. (2021). Recovery of visuospatial neglect subtypes and relationship to functional outcome six months after stroke. Neurorehabilitation and Neural Repair, 35(9), 823–835. https://doi.org/10.1177/15459683211032977
   PubMed Web of Science ®Google Scholar
• Morrison, M. T., Giles, G. M., Ryan, J. D., Baum, C. M., Dromerick, A. W., Polatajko, H. J., & Edwards, D. F. (2013). Multiple Errands Test–Revised (MET–R): A performance-based measure of executive function in people with mild cerebrovascular accident. American Journal of Occupational Therapy, 67(4), 460–468. https://doi.org/10.5014/ajot.2013.007880
   PubMed Web of Science ®Google Scholar
• Nagamatsu, L. S., Voss, M., Neider, M. B., Gaspar, J. G., Handy, T. C., Kramer, A. F., & Liu-Ambrose, T. Y. L. (2011). Increased cognitive load leads to impaired mobility decisions in seniors at risk for falls. Psychology and Aging, 26(2), 253–259. https://doi.org/10.1037/a0022929
   PubMed Web of Science ®Google Scholar
• Nalder, E. J., Clark, A. J., Anderson, N. D., & Dawson, D. R. (2017). Clinicians’ perceptions of the clinical utility of the multiple errands test for adults with neurological conditions. Neuropsychological Rehabilitation, 27(5), 685–706. https://doi.org/10.1080/09602011.2015.1067628
   PubMed Web of Science ®Google Scholar
• Nasreddine, Z. S., Phillips, N. A., Bédirian, V., Charbonneau, S., Whitehead, V., Collin, I., Cummings, J. L., & Chertkow, H. (2005). The Montreal cognitive assessment, MoCA: A brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53(4), 695–699. https://doi.org/10.1111/j.1532-5415.2005.53221.x
   PubMed Web of Science ®Google Scholar
• Nys, G. M. S., van der Worp, H. B., van Zandvoort, M. J. E., de Haan, E. H. F., de Kort, P. L. M., Jansen, B. P. W., & Kappelle, L. J. (2006). Early cognitive impairment predicts long-term depressive symptoms and quality of life after stroke. Journal of the Neurological Sciences, 247(2), 149–156. https://doi.org/10.1016/j.jns.2006.04.005
   PubMed Web of Science ®Google Scholar
• Ownsworth, T., & Shum, D. (2008). Relationship between executive functions and productivity outcomes following stroke. Disability and Rehabilitation, 30(7), 531–540. https://doi.org/10.1080/09638280701355694
   PubMed Web of Science ®Google Scholar
• Parikh, R. M., Robinson, R. G., Lipsey, J. R., Starkstein, S. E., Fedoroff, J. P., & Price, T. R. (1990). The impact of poststroke depression on recovery in activities of daily living over a 2-year follow-up. Archives of Neurology, 47(7), 785–789. https://doi.org/10.1001/archneur.1990.00530070083014
   PubMed Web of Science ®Google Scholar
• Pohjasvaara, T., Leskelä, M., Vataja, R., Kalska, H., Ylikoski, R., Hietanen, M., Leppävuori, A., Kaste, M., & Erkinjuntti, T. (2002). Post-stroke depression, executive dysfunction and functional outcome. European Journal of Neurology, 9(3), 269–275. https://doi.org/10.1046/j.1468-1331.2002.00396.x
   PubMed Web of Science ®Google Scholar
• Quinn, T. J., Elliott, E., & Langhorne, P. (2018). Cognitive and mood assessment tools for use in stroke. Stroke, 49(2), 483–490. https://doi.org/10.1161/STROKEAHA.117.016994
   PubMed Web of Science ®Google Scholar
• Quinn, T. J., Langhorne, P., & Stott, D. J. (2011). Barthel index for stroke trials. Stroke, 42(4), 1146–1151. https://doi.org/10.1161/STROKEAHA.110.598540
   PubMed Web of Science ®Google Scholar
• Rand, D., & Katz, N. (2009). Training multitasking in a virtual supermarket: A novel intervention after stroke. American Journal of Occupational Therapy, 63(5). https://doi.org/10.5014/ajot.63.5.535simm
   PubMed Web of Science ®Google Scholar
• Rand, D., Katz, N., Shahar, M., Kizony, R., & Weiss, P. L. (2005). The virtual mall: A functional virtual environment for stroke rehabilitation. Annual Review of Cybertherapy and Telemedicine: A Decade of VR, 3, 193–198.
   Google Scholar
• Rand, D., Rukan, S. B.-A., Weiss, P. L., & Katz, N. (2009). Validation of the virtual MET as an assessment tool for executive functions. Neuropsychological Rehabilitation, 19(4), 583–602. https://doi.org/10.1080/09602010802469074
   PubMed Web of Science ®Google Scholar
• Rankin, J. (1957). Cerebral vascular accidents in patients over the age of 60: II. Prognosis. Scottish Medical Journal, 2(5), 200–215. https://doi.org/10.1177/003693305700200504
   PubMedGoogle Scholar
• Raspelli, S., Pallavicini, F., Carelli, L., Poletti, B., Corra, B., Silani, V., & Riva, G. (2011). Validation of a neuro virtual reality- based version of the multiple errands test for the assessment of executive functions. Studies in Health Technology and Informatics, 167, 92–97.
   PubMedGoogle Scholar
• Robnett, R. H., Hahn, K., & Roland, T. (2021). The development of a multiple errands test for pre/post concussive testing on a college campus: The university multiple errands test-lessons learned.
   Google Scholar
• Roper, A. (2017). Computer gesture therapy for adults with severe aphasia. University Lonon. https://openaccess.city.ac.uk/id/eprint/18030/
   Google Scholar
• Rotenberg, S., Ruthralingam, M., Hnatiw, B., Neufeld, K., Yuzwa, K. E., Arbel, I., & Dawson, D. R. (2020). Measurement properties of the multiple errands test: A systematic review. Archives of Physical Medicine and Rehabilitation, 101(9), 1628–1842. https://doi.org/10.1016/j.apmr.2020.01.019
   PubMed Web of Science ®Google Scholar
• Salter, K. L., Teasell, R. W., Foley, N. C., & Jutai, J. W. (2007). Outcome assessment in randomized controlled trials of stroke rehabilitation. American Journal of Physical Medicine & Rehabilitation, 86(12), 1007–1012. https://doi.org/10.1097/PHM.0b013e3181587b3d
   PubMed Web of Science ®Google Scholar
• Scarff, S. M., Nalder, E. J., Gullo, H. L., & Fleming, J. (2022). The multiple errands test: A guide for site-specific version development. Canadian Journal of Occupational Therapy, 00084174221142184. https://doi.org/10.1177/00084174221142184
   Web of Science ®Google Scholar
• Schönbrodt, F. D., & Perugini, M. (2013). At what sample size do correlations stabilize? Journal of Research in Personality, 47(5), 609–612. https://doi.org/10.1016/j.jrp.2013.05.009
   Web of Science ®Google Scholar
• Shallice, T., & Burgess, P. (1991). Deficits in strategy application following frontal lobe damage in man. Brain : A Journal of Neurology, 114(2), 727–741. https://doi.org/10.1093/brain/114.2.727
   PubMed Web of Science ®Google Scholar
• Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2012). A 21 word solution. Available at SSRN 2160588. https://doi.org/10.2139/ssrn.2160588
   Google Scholar
• Snyder, H., Miyake, A., & Hankin, B. (2015). Advancing understanding of executive function impairments and psychopathology: Bridging the gap between clinical and cognitive approaches. Frontiers In Psychology, 6. https://doi.org/10.3389/fpsyg.2015.00328
   PubMed Web of Science ®Google Scholar
• Tian, Y., Thompson, J., Buck, D., & Sonola, L. (2013). Exploring the system-wide costs of falls in older people in Torbay (ISBN978 1 909029 15 6; p. 12). The Kings Fund. https://www.kingsfund.org.uk/publications/exploring-system-wide-costs-falls-older-people-torbay#:~:text = While%20falls%20patients%20in%20this,local%20adult%20social%20care%20budget
   Google Scholar
• Tien, A. Y., Spevack, T. V., Jones, D. W., Pearlson, G. D., Schlaepfer, T. E., & Strauss, M. E. (1996). Computerized Wisconsin card sorting test: Comparison with manual administration. The Kaohsiung Journal of Medical Sciences, 12(8), 479–485.
   PubMedGoogle Scholar
• van der Zwaluw, C. S., Valentijn, S. A. M., Nieuwenhuis-Mark, R., Rasquin, S. M. C., & van Heugten, C. M. (2011). Cognitive functioning in the acute phase poststroke: A predictor of discharge destination? Journal of Stroke and Cerebrovascular Diseases, 20(6), 549–555. https://doi.org/10.1016/j.jstrokecerebrovasdis.2010.03.009
   PubMed Web of Science ®Google Scholar
• Verstraeten, S., Mark, R., & Sitskoorn, M. (2016). Motor and cognitive impairment after stroke: A common bond or a simultaneous deficit. Stroke Research & Therapy, 1(1), 1.
   Google Scholar
• von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007). The strengthening the reporting of observational studies in epidemiology (STROBE) statement: Guidelines for reporting observational studies. The Lancet, 370(9596), 1453–1457. https://doi.org/10.1016/S0140-6736(07)61602-X
   PubMed Web of Science ®Google Scholar
• Webb, S. S., Anders, J., Chiu, E. G., Payne, F., Basting, R., Duta, M. D., & Demeyere, N. (2021). The Oxford Digital Multiple Errands Test (OxMET). Validation of a Simplified Computer Tablet Based Multiple Errands Test. Neuropsychological Rehabilitation, https://doi.org/10.1080/09602011.2020.1862679
   Google Scholar
• Webb, S. S., & Demeyere, N. (2021). Multiverse analysis: A method to determine researcher degrees of freedom in test validation. https://doi.org/10.31234/osf.io/nhrwq.
   Google Scholar
• Webb, S. S., & Demeyere, N. (2023). Predictive validity of the Oxford Digital Multiple Errands Test (OxMET) for functional outcomes after stroke. PsyArXiv. https://doi.org/10.31234/osf.io/agb3j
   Google Scholar
• Wei, W. E., De Silva, D. A., Chang, H. M., Yao, J., Matchar, D. B., Young, S. H. Y., See, S. J., Lim, G. H., Wong, T. H., & Venketasubramanian, N. (2019). Post-stroke patients with moderate function have the greatest risk of falls: A national cohort study. BMC Geriatrics, 19(1), 373. https://doi.org/10.1186/s12877-019-1377-7
   PubMed Web of Science ®Google Scholar