Which training methods are effective for learning new smartphone memory apps after acquired brain injury? A pilot randomized controlled trial comparing trial and error, systematic instruction and error-based learning

References

• 24meLtd. (2018). 24me Smart Personal Assistant (V. 5.5.6) [Mobile application software]. https://www.twentyfour.me
   Google Scholar
• 6WunderkinderGmbH. (2015). Wunderlist: To-Do List & Tasks (V. 3.4.15) [Mobile application software]. https://www.wunderlist.com
   Google Scholar
• Australian Department of Health. (2020). Australian Health sector emergency response plan for novel coronavirus COVID 19. In: Australia Co, editor: Australian government Department of Health.
   Google Scholar
• Bartfai, A., & Boman, I. L. (2014). A multiprofessional client-centred guide to implementing assistive technology for clients with cognitive impairments. Technology and Disability, 26(1), 11–21. https://doi.org/10.3233/TAD-140400
   Google Scholar
• Bay, E., Kalpakjian, C., & Giordani, B. (2012). Determinants of subjective memory complaints in community-dwelling adults with mild-to-moderate traumatic brain injury. Brain Injury, 26(7–8), 941–949. https://doi.org/10.3109/02699052.2012.666365
   PubMed Web of Science ®Google Scholar
• Bellg, A., Borrelli, B., Resnick, B., Hecht, J., Sharp Minicucci, D., Ory, M, Ogedegbe, G., Orwig, D., Ernst, D., & Czajkowski, S. (2004). Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH Behavior Change Consortium. Health Psychology, 23(5), 443–451. https://doi.org/10.1037/0278-6133.23.5.443
   PubMed Web of Science ®Google Scholar
• Benedict, R., Schretlen, D., Groninger, L., Dobraski, M., & Shpritz, B. (1996). Revision of the brief Visuospatial Memory Test: Studies of normal performance, reliability, and validity. Psychological Assessment, 8(2), 145–153. https://doi.org/10.1037/1040-3590.8.2.145
   Web of Science ®Google Scholar
• Bertens, D., & Brazil, I. A. (2018). Cognitive and neural correlates of errorless learning. In C. Haslam & R. P. Kessels (Eds.), Errorless learning in neuropsychological rehabilitation: Mechanisms, efficacy and application (pp. 26–40). Routledge.
   Google Scholar
• Borrelli, B. (2011). The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. Journal of Public Health Dentistry, 71(s1), S52–S63. https://doi.org/10.1111/j.1752-7325.2011.00233.x
   Web of Science ®Google Scholar
• Bos, H., Babbage, D., & Leathem, J. (2017). Efficacy of memory aids after traumatic brain injury: A single case series. NeuroRehabilitation, 41(1), 1–19. https://doi.org/10.3233/NRE-171451
   PubMedGoogle Scholar
• Brand, S., Reimer, T., & Opwis, K. (2007). How do we learn in a negative mood? Effects of a negative mood on transfer and learning. Learning and Instruction, 17(1), 1–16. https://doi.org/10.1016/j.learninstruc.2006.11.002
   Web of Science ®Google Scholar
• Brandt, Å, Jensen, M. P., Søberg, M. S., Andersen, S.D., & Sund, T. (2020). Information and communication technology-based assistive technology to compensate for impaired cognition in everyday life: A systematic review. Disability and Rehabilitation: Assistive Technology, 15(7), 1–15. 10.1080/17483107.2020.1765032
   PubMed Web of Science ®Google Scholar
• Buchanan, E., Scofield, J., & Valentine, K. D. (2020). MOTE: Effect Size and Confidence Interval Calculator 2017 [cited 2020]. Available from: https://doomlab.shinyapps.io/mote/
   Google Scholar
• Burgess, P. W., & Shallice, T. (1997). The hayling and brixton tests. Edmonds. Thames Valley Test Company Bury St.
   Google Scholar
• Charters, E., Gillett, L., & Simpson, G. K. (2015). Efficacy of electronic portable assistive devices for people with acquired brain injury: A systematic review. Neuropsychological Rehabilitation, 25(1), 82–121. https://doi.org/10.1080/09602011.2014.942672
   PubMed Web of Science ®Google Scholar
• Cicerone, K. D., Goldin, Y., Ganci, K., Rosenbaum, A., Wethe, J.V., Langenbahn, D.M., Malec, J.F., Bergquist, T.F., Kingsley, K., Nagele, D., Trexler, L., Fraas, M., Bogdanova, Y., Harley, J.P., (2019). Evidence-based cognitive rehabilitation: Systematic review of the literature from 2009 through 2014. Archives of Physical Medicine and Rehabilitation, 100(8), 1515–1533. https://doi.org/10.1016/j.apmr.2019.02.011
   PubMed Web of Science ®Google Scholar
• Clare, L., & Jones, R. S. (2008). Errorless learning in the rehabilitation of memory impairment: A critical review. Neuropsychology Review, 18(1), 1–23. https://doi.org/10.1007/s11065-008-9051-4
   PubMed Web of Science ®Google Scholar
• CoziInc. (2018). Cozi Family Organiser (V. 9.8.8) [Mobile application software]. https://www.cozi.com
   Google Scholar
• Craig, M., Dewar, M., & Sala, S. D. (2015). Retroactive interference. In J. D. Wright (Ed.), International encyclopedia of the social & behavioral sciences (Second ed., pp. 613–620). Elsevier.
   Google Scholar
• Czaja, S. J., Charness, N., Fisk, A. D., Hertzog, C., Nair, S.N., Rogers, W.A., Sharit, J., (2006). Factors predicting the use of technology: Findings from the center for research and education on aging and technology enhancement (CREATE). Psychology and Aging, 21(2), 333–352. https://doi.org/10.1037/0882-7974.21.2.333
   PubMed Web of Science ®Google Scholar
• Delis, D. C., Kaplan, E., Kramer, J. H., & Ober, B.A. 2008. California verbal learning test (CVLT). ECPA.
   Google Scholar
• Downing, M., Bragge, P., & Ponsford, J. (2019). Cognitive rehabilitation following traumatic brain injury: A survey of current practice in Australia. Brain Impairment, 20(1), 24–36. https://doi.org/10.1017/BrImp.2018.12
   Web of Science ®Google Scholar
• Ehlhardt, L. A., Sohlberg, M. M., Kennedy, M., Coelho, C., Ylvisaker, M., Turkstra, L., & Yorkston, K. (2008). Evidence-based practice guidelines for instructing individuals with neurogenic memory impairments: What have we learned in the past 20 years? Neuropsychological Rehabilitation, 18(3), 300–342. https://doi.org/10.1080/09602010701733190
   PubMed Web of Science ®Google Scholar
• EMA. (2015). Guideline for adjustment of baseline covariates in clinical trials. [2015 cited]. https://www.ema.europa.eu/en/documents/scientific-guideline/guideline-adjustment-baseline-covariates-clinical-trials_en.pdf
   Google Scholar
• Engel, L., Chui, A., Goverover, Y., & Dawson, D.T. (2019). Optimising activity and participation outcomes for people with self-awareness impairments related to acquired brain injury: An interventions systematic review. Neuropsychological Rehabilitation, 29(2), 163–198. https://doi.org/10.1080/09602011.2017.1292923
   PubMed Web of Science ®Google Scholar
• Erikson, A., Karlsson, G., Soderstrom, M., & Tham, K. (2004). A training apartment with electronic aids to daily living: Lived experiences of persons with brain damage [clinical report]. The American Journal of Occupational Therapy, 58(3), 261–271https://doi.org/10.5014/ajot.58.3.261.
   PubMed Web of Science ®Google Scholar
• Evald, L. (2018). Prospective memory rehabilitation using smartphones in patients with TBI. Disability and Rehabilitation, 40(19), 2250–2259. https://doi.org/10.1080/09638288.2017.1333633
   PubMed Web of Science ®Google Scholar
• Evans, J. (2018). Application of errorless learning in adult acquired brain injury rehabilitation. In C. Haslam & R. P. Kessels (Eds.), Errorless learning in neuropsychological rehabilitation: Mechanisms, efficacy and application (pp. 58–81). Routledge.
   Google Scholar
• Evans, J. J., Wilson, B., Schuri, U., Andrade, J., Baddeley, A., Bruna, O., Canavan, T., Del Sala, S., Green, R., Laaksonen, R., Lorenzi, L., & Taussik, I. (2000). A comparison of ‘errorless’ and ‘trial-and-error’ learning methods for teaching individuals with acquired memory deficits. Neuropsychological Rehabilitation, 10(1), 67–101. https://doi.org/10.1080/096020100389309
   Web of Science ®Google Scholar
• Fallahpour, M., Kottorp, A., Nygård, L., & Lund, M.L. (2014). Perceived difficulty in use of everyday technology in persons with acquired brain injury of different severity: A comparison with controls. Journal of Rehabilitation Medicine, 46(7), 635. https://doi.org/10.2340/16501977-1818
   PubMed Web of Science ®Google Scholar
• Ferguson, S., Friedland, D., & Woodberry, E. (2015). Smartphone technology: Gentle reminders of everyday tasks for those with prospective memory difficulties post-brain injury. Brain Injury, 29(5), 583–591. https://doi.org/10.3109/02699052.2014.1002109
   PubMed Web of Science ®Google Scholar
• Fleming, J. M., Shum, D., Strong, J., Lightbody, S., (2005). Prospective memory rehabilitation for adults with traumatic brain injury: A compensatory training programme. Brain Injury, 19(1), 1–10. https://doi.org/10.1080/02699050410001720059
   PubMed Web of Science ®Google Scholar
• Garcia-Molina, A., Roig-Rovira, T., Ensenat-Cantallops, A., Sanchez-Carrion, R., Pico-Azanza, N., Bernabeu, M., & Tormos, J. (2006). Neuropsychological profile of persons with anoxic brain injury: Differences regarding physiopathological mechanism. Brain Injury, 20(11), 1139–1145. https://doi.org/10.1080/02699050600983248
   PubMed Web of Science ®Google Scholar
• Hills, A. M. (2011). Foolproof guide to statistics using IBM SPSS. French Forest NSW: Pearson.
   Google Scholar
• Howell, D. C. (2012). Statistical methods for psychology. Cengage Learning.
   Google Scholar
• Hu, F., Hu, Y., Ma, Z., & Rosenberger, W.F. (2014). Adaptive randomization for balancing over covariates. Wiley Interdisciplinary Reviews: Computational Statistics, 6(4), 288–303. https://doi.org/10.1002/wics.1309
   Google Scholar
• Jamieson, M., Cullen, B., McGee-Lennon, M., et al. (2017). Technological memory aid use by people with acquired brain injury. Neuropsychological Rehabilitation, 27(6), 919–936. https://doi.org/10.1080/09602011.2015.1103760
   PubMed Web of Science ®Google Scholar
• Jamieson, M., Cullen, B., McGee-Lennon, M., Brewster, S., Evans, J.J., (2014). The efficacy of cognitive prosthetic technology for people with memory impairments: A systematic review and meta-analysis. Neuropsychological Rehabilitation, 24(3–4), 419–444. https://doi.org/10.1080/09602011.2013.825632
   PubMed Web of Science ®Google Scholar
• Jokinen, H., Melkas, S., Ylikoski, R., et al. (2015). Post-stroke cognitive impairment is common even after successful clinical recovery. European Journal of Neurology, 22(9), 1288–1294. https://doi.org/10.1111/ene.12743
   PubMed Web of Science ®Google Scholar
• Kalyuga, S. (2011). Cognitive load theory: How many types of load does it really need? Educational Psychology Review, 23(1), 1–19. https://doi.org/10.1007/s10648-010-9150-7
   Web of Science ®Google Scholar
• Kneer, J. (2017). The SAGE encyclopedia of communication research methods.
   Google Scholar
• Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
   PubMed Web of Science ®Google Scholar
• Lachman, M. E., Bandura, M., Weaver, S. L., & Elliott, E. (1995). Assessing memory control beliefs: The memory controllability inventory. Aging, Neuropsychology, and Cognition, 2(1), 67–84. https://doi.org/10.1080/13825589508256589
   Web of Science ®Google Scholar
• Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004). Design and analysis of pilot studies: Recommendations for good practice. Journal of Evaluation in Clinical Practice, 10(2), 307–312. https://doi.org/10.1111/j..2002.384.doc.x
   PubMed Web of Science ®Google Scholar
• McCoy, C. E. (2017). Understanding the intention-to-treat principle in randomized controlled trials. Western Journal of Emergency Medicine, 18(6), 1075–1078. https://doi.org/10.5811/westjem.2017.8.35985
   PubMed Web of Science ®Google Scholar
• McDonald, A., Haslam, C., Yates, P., Gurr, B., Leeder, G., & Sayers, A. (2011). Google calendar: A new memory aid to compensate for prospective memory deficits following acquired brain injury. Neuropsychological Rehabilitation, 21(6), 784–807. https://doi.org/10.1080/09602011.2011.598405
   PubMed Web of Science ®Google Scholar
• McDonald, S., Ownsworth, T., & Wong, D. (in press). Interventions for psychosocial and emotional sequelae of brain injury and disease. In B. Crosson, G. G. Brown, K. Haaland, & T. King (Eds.), APA handbook of neuropsychology (Volume II). American Psychological Association.
   Google Scholar
• Middleton, E. L., & Schwartz, M. F. (2012). Errorless learning in cognitive rehabilitation: A critical review. Neuropsychological Rehabilitation, 22(2), 138–168. https://doi.org/10.1080/09602011.2011.639619
   PubMed Web of Science ®Google Scholar
• Nasreddine, Z. S., Phillips, N. A., Bedirian, V., Charbonneau, S., Whitehead, V., Collin, I., Cummings, J.L., & Chertkow, H. (2005). The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53(4), 695–699. https://doi.org/10.1111/j.1532-5415.2005.53221.x
   PubMed Web of Science ®Google Scholar
• Nouri, F., & Lincoln, N. (1987). An extended activities of daily living scale for stroke patients. Clinical Rehabilitation, 1(4), 301–305. https://doi.org/10.1177/026921558700100409
   Google Scholar
• Oulasvirta, A., Wahlström, M., & Anders Ericsson, K. (2011). What does it mean to be good at using a mobile device? An investigation of three levels of experience and skill. International Journal of Human-Computer Studies, 69(3), 155–169. https://doi.org/10.1016/j.ijhcs.2010.11.003
   Web of Science ®Google Scholar
• Ownsworth, T. (2018). Errors: Friend or foe?: The theory and evidence base for error-based learning. In C. Haslam & R. P. Kessels (Eds.), Errorless learning in neuropsychological rehabilitation: Mechanisms, efficacy and application (pp. 164–179). Routledge.
   Google Scholar
• Ownsworth, T., Fleming, J., Tate, R., et al. (2017). Do people with severe traumatic brain injury benefit from making errors? A randomized controlled trial of error-based and Errorless learning. Neurorehabilitation and Neural Repair, 0(0), 1–11.
   Google Scholar
• Ownsworth, T., Fleming, J., Tate, R., Shum, D.H., Griffin, J., Schmidt, J., Lane-Brown, A., Kendall, M., & Chevignard, M. (2013). Comparison of error-based and errorless learning for people with severe traumatic brain injury: Study protocol for a randomized control trial. Trials, 14(1), 369. https://doi.org/10.1186/1745-6215-14-369
   PubMed Web of Science ®Google Scholar
• Parker, G., Haslam, C., Fleming, J., & Shum, D. (2017). Rehabilitation of memory disorders in adults and children. In B. A. Wilson, J. Winegardner, & H. C. M. van, et al. (Eds.), Neuropsychological rehabilitation: The international handbook (pp. 196–216). Routledge.
   Google Scholar
• Ponsford, J. L., Downing, M. G., Olver, J., Ponsford, M., Acher, R., Carty, M., & Spitz, G. (2014). Longitudinal follow-up of patients with traumatic brain injury: Outcome at two, five, and ten years post-injury. Journal of Neurotrauma, 31(1), 64–77. https://doi.org/10.1089/neu.2013.2997
   PubMed Web of Science ®Google Scholar
• Powell, L. E., Glang, A., Ettel, D., Todis, B., Sohlberg, M., & Albin, R. (2012). Systematic instruction for individuals with acquired brain injury: Results of a randomized controlled trial. Neuropsychological Rehabilitation, 22(1), 85–112. https://doi.org/10.1080/09602011.2011.640466
   PubMed Web of Science ®Google Scholar
• Ramirez-Hernandez, D., Stolwyk, R. J., Chapman, J., & Wong, D. (2021). The experience and acceptability of smartphone reminder app training for people with acquired brain injury: A mixed methods study. Neuropsychological Rehabilitation, 1–28. 10.1080/09602011.2021.1879875
   PubMed Web of Science ®Google Scholar
• Ramirez-Hernandez, D., Stolwyk, R. J., Ownsworth, T., & Wong, D. (2020). A comparison of systematic instruction, error-based learning and trial and error to train the use of smartphone memory apps after acquired brain injury: A three-armed phase II randomised controlled trial study protocol. Brain Impairment, 22(2), 217–232. 10.1017/BrImp.2020.10
   Web of Science ®Google Scholar
• Raskin, S. A., Williams, J., & Aiken, E. M. (2018). A review of prospective memory in individuals with acquired brain injury. The Clinical Neuropsychologist, 32(5), 891–921. https://doi.org/10.1080/13854046.2018.1455898
   PubMed Web of Science ®Google Scholar
• Rea, L. M., & Parker, R. A. (2014). Designing and conducting survey research: A comprehensive guide. John Wiley & Sons, Incorporated.
   Google Scholar
• Reitan, R. M., & Wolfson, D. (1985). The Halstead-Reitan neuropsychological test battery: Theory and clinical interpretation, Vol. 4. Neuropsychology Press.
   Google Scholar
• Royle, J., & Lincoln, N. B. (2008). The everyday memory questionnaire-revised: Development of a 13-item scale. Disability and Rehabilitation, 30(2), 114–121. https://doi.org/10.1080/09638280701223876
   PubMed Web of Science ®Google Scholar
• Scheper, I., de Bruijn, E. R. A., Bertens, D., Kessels, R. P. C., & Brazil, I. A. (2019). The impact of error frequency on errorless and errorful learning of object locations using a novel paradigm. Memory (Hove, England), 27(10), 1371–1380. https://doi.org/10.1080/09658211.2019.1661493
   PubMedGoogle Scholar
• Schmidt, J., Fleming, J., Ownsworth, T., & Lannin, N. (2013). Video feedback on functional task performance improves self-awareness after traumatic brain injury: A randomized controlled trial. Neurorehabilitation and Neural Repair, 27(4), 316–324. https://doi.org/10.1177/1545968312469838
   PubMed Web of Science ®Google Scholar
• Schütz, H., Caspers, S., Moebus, S., & Lux, S. (2020). Prevalence and psychosocial correlates of subjectively perceived decline in five cognitive domains: Results from a population-based cohort study in Germany. International Journal of Geriatric Psychiatry, 35(10), 1219–1227. https://doi.org/10.1002/gps.5359
   PubMed Web of Science ®Google Scholar
• Sohlberg, M., Ehlhardt, L., & Kennedy, M. (2005). Instructional techniques in cognitive rehabilitation: A preliminary report. Seminars in Speech and Language, 26(4), 268–279. https://doi.org/10.1055/s-2005-922105
   PubMedGoogle Scholar
• Sun, S., Pan, W., & Wang, L. L. (2010). A comprehensive review of effect size reporting and interpreting practices in academic journals in education and psychology. US: American Psychological Association, https://doi.org/10.1037/a0019507
   Google Scholar
• Svoboda, E., Richards, B., Leach, L., & Mertens, V. (2012). PDA and smartphone use by individuals with moderate-to-severe memory impairment: Application of a theory-driven training programme. Neuropsychological Rehabilitation, 22(3), 408–427. https://doi.org/10.1080/09602011.2011.652498
   PubMed Web of Science ®Google Scholar
• Svoboda, E., Richards, B., Polsinelli, A., & Guger, S. (2010). A theory-driven training programme in the use of emerging commercial technology: Application to an adolescent with severe memory impairment. Neuropsychological Rehabilitation, 20(4), 562–586. https://doi.org/10.1080/09602011003669918
   PubMed Web of Science ®Google Scholar
• Toglia, J., Johnston, M. V., Goverover, Y., & Dain, B. (2010). A multicontext approach to promoting transfer of strategy use and self regulation after brain injury: An exploratory study. Brain Injury, 24(4), 664–677. https://doi.org/10.3109/02699051003610474
   PubMed Web of Science ®Google Scholar
• Tyng, C. M., Amin, H. U., Saad, M. N. M., & Malik, A. S. (2017). The influences of emotion on learning and memory [review]. Frontiers in Psychology, 8(1454), 1–22. https://doi.org/10.3389/fpsyg.2017.01454
   PubMedGoogle Scholar
• Vaezipour, A., Whelan, B. M., Wall, K., & Theodoros, D. (2019). Acceptance of rehabilitation technology in adults with moderate to severe traumatic brain injury. Their Caregivers, and Healthcare Professionals: A Systematic Review. Journal of Head Trauma Rehabilitation, 34(4), E67–e82. https://doi.org/10.1097/HTR.0000000000000462
   PubMed Web of Science ®Google Scholar
• Van Breukelen, G. J., & Van Dijk, K. R. (2007). Use of covariates in randomized controlled trials. Journal of the International Neuropsychological Society, 13(5), 903–904. https://doi.org/10.1017/S1355617707071147
   PubMed Web of Science ®Google Scholar
• Wei, J., Carroll, R. J., Harden, K. K., & Wu, G. (2012). Comparisons of treatment means when factors do not interact in two-factorial studies. Amino Acids, 42(5), 2031–2035. https://doi.org/10.1007/s00726-011-0924-0
   PubMed Web of Science ®Google Scholar
• Wilson, B., Baddeley, A., Evans, J., & Shiel, A. (1994). Errorless learning in the rehabilitation of memory impaired people. Neuropsychological Rehabilitation, 4(3), 307–326. https://doi.org/10.1080/09602019408401463
   Web of Science ®Google Scholar
• Wong, D., Wang, Q. J., Stolwyk, R., & Ponsford, J. (2017). Do smartphones have the potential to support cognition and independence following stroke? Brain Impairment, 18(3), 310–320. 10.1017/BrImp.2017.10
   Web of Science ®Google Scholar
• Zigmond, A. S., & Snaith, R. P. (1983). The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica, 67(6), 361–370. https://doi.org/10.1111/j.1600-0447.1983.tb09716.x
   PubMed Web of Science ®Google Scholar