Digital neuropsychology: Challenges and opportunities at the intersection of science and software

References

• Abrahamsson, P., Salo, O., Ronkainen, J., & Warsta, J. (2017). Agile software development methods: Review and analysis. arXiv. preprint arXiv:1709.08439.
   Google Scholar
• Anderson, M., & Perrin, A. (2017). Technology use among seniors. Washington, DC: Pew Research Center.
   Google Scholar
• Armstrong, K. A., Semple, J. L., & Coyte, P. C. (2014). Replacing ambulatory surgical follow-up visits with mobile app home monitoring: Modeling cost-effective scenarios. Journal of Medical Internet Research, 16(9), e213.
   PubMedGoogle Scholar
• Arnett, P. (Ed.). (2013). Secondary influences on neuropsychological test performance. Oxford: Oxford University Press.
   Google Scholar
• Bailey, S. K., Neigel, A. R., Dhanani, L. Y., & Sims, V. K. (2017). Establishing measurement equivalence across computer- and paper-based tests of spatial cognition. Human Factors, 60, 340–350. 0018720817747731.
   PubMed Web of Science ®Google Scholar
• Begnum, M. E. N., & Begnum, K. M. (2012). On the usefulness of off-the-shelf computer peripherals for people with Parkinson’s Disease. Universal Access in the Information Society, 11(4), 347–357.
   Web of Science ®Google Scholar
• Bot, B. M., Suver, C., Neto, E. C., Kellen, M., Klein, A., Bare, C., … Trister, A. D. (2016). The mPower study, Parkinson disease mobile data collected using ResearchKit. Scientific Data, 3, 160011.
   PubMed Web of Science ®Google Scholar
• Brhel, M., Meth, H., Maedche, A., & Werder, K. (2015). Exploring principles of user-centered agile software development: A literature review. Information and Software Technology, 61, 163–181.
   Web of Science ®Google Scholar
• Brisswalter, J., Collardeau, M., & René, A. (2002). Effects of acute physical exercise characteristics on cognitive performance. Sports Medicine, 32(9), 555–566.
   PubMed Web of Science ®Google Scholar
• Buckley, R. F., Sparks, K. P., Papp, K. V., Dekhtyar, M., Martin, C., Burnham, S., … Rentz, D. M. (2017). Computerized cognitive testing for use in clinical trials: A comparison of the NIH Toolbox and Cogstate C3 batteries. The Journal of Prevention of Alzheimer's Disease, 4(1), 3.
   PubMed Web of Science ®Google Scholar
• Byrom, B., Muehlhausen, W., Flood, E., Cassedy, C., Skerritt, B., & Mc Carthy, M. (2017). Patient attitudes and acceptability towards using their own mobile device to record patient reported outcomes data in clinical trials. Scoliosis, 6, 4.
   Google Scholar
• Pew Research Center. (2018). Demographics of mobile devices ownership in the United States. Retrieved from http://www.pewinternet.org/fact-sheet/mobile/
   Google Scholar
• Chan, M. Y., Haber, S., Drew, L. M., & Park, D. C. (2016). Training older adults to use tablet computers: Does it enhance cognitive function? The Gerontologist, 56(3), 475–484.
   PubMed Web of Science ®Google Scholar
• Chaytor, N., & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13(4), 181–197.
   PubMed Web of Science ®Google Scholar
• Climent, G., & Banterla, F. (2011). AULA, ecological evaluation of attentional processes. San Sebastian: Nesplora.
   Google Scholar
• Cook, D. J., Schmitter-Edgecombe, M., & Jonsson, L. (2018). Technology-enabled assessment of functional health. IEEE Reviews in Biomedical Engineering.
   PubMedGoogle Scholar
• Cole, W. R., Gregory, E., Arrieux, J. P., & Haran, F. J. (2018). Intraindividual cognitive variability: An examination of ANAM4 TBI-MIL simple reaction time data from service members with and without mild traumatic brain injury. Journal of the International Neuropsychological Society, 24(2), 156–162.
   PubMed Web of Science ®Google Scholar
• Corrigan, J. D., & Hinkeldey, N. S. (1987). Relationships between parts A and B of the trail making test. Journal of Clinical Psychology, 43(4), 402–409.
   PubMed Web of Science ®Google Scholar
• Crowe, S. F. (1998). The differential contribution of mental tracking, cognitive flexibility, visual search, and motor speed to performance on parts A and B of the trail making test. Journal of Clinical Psychology, 54(5), 585–591.
   PubMed Web of Science ®Google Scholar
• Daniel, M. H., Wahlstrom, D., & Zhang, O. (2014). Equivalence of Q-interactive™ and paper administrations of cognitive tasks: WISC®–V (Q-interactive Technical Report 8).
   Google Scholar
• De Leeuw, J. R. (2015). jsPsych: A JavaScript library for creating behavioral experiments in a Web browser. Behavior Research Methods, 47(1), 1–12.
   PubMed Web of Science ®Google Scholar
• DeGutis, J., Wilmer, J., Mercado, R. J., & Cohan, S. (2013). Using regression to measure holistic face processing reveals a strong link with face recognition ability. Cognition, 126(1), 87–100.
   PubMed Web of Science ®Google Scholar
• Desilver, D. (2013). As it turns 6, a look at who uses the iPhone (no, not 'everybody'). Washington, DC: Pew Research Center.
   Google Scholar
• Díaz-Orueta, U., Garcia-López, C., Crespo-Eguílaz, N., Sánchez-Carpintero, R., Climent, G., & Narbona, J. (2014). AULA virtual reality test as an attention measure: Convergent validity with Conners’ Continuous Performance Test. Child Neuropsychology, 20(3), 328–342.
   PubMed Web of Science ®Google Scholar
• Estai, M., Kanagasingam, Y., Xiao, D., Vignarajan, J., Bunt, S., Kruger, E., & Tennant, M. (2017). End-user acceptance of a cloud-based teledentistry system and android phone app for remote screening for oral diseases. Journal of Telemedicine and Telecare, 23(1), 44–52.
   PubMed Web of Science ®Google Scholar
• Foster, E. D., & Deardorff, A. (2017). Open science framework (OSF). Journal of the Medical Library Association, 105(2), 203.
   Google Scholar
• Gamaldo, A. A., Allaire, J. C., & Whitfield, K. E. (2010). Exploring the within-person coupling of sleep and cognition in older African Americans. Psychology and Aging, 25(4), 851.
   PubMed Web of Science ®Google Scholar
• Germine, L., Nakayama, K., Duchaine, B. C., Chabris, C. F., Chatterjee, G., & Wilmer, J. B. (2012). Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experiments. Psychonomic Bulletin & Review, 19(5), 847–857.
   PubMed Web of Science ®Google Scholar
• Giannouli, E., Bock, O., & Zijlstra, W. (2018). Cognitive functioning is more closely related to real-life mobility than to laboratory-based mobility parameters. European Journal of Ageing, 15(1), 57–65.
   PubMed Web of Science ®Google Scholar
• Gold, A. E., MacLeod, K. M., Deary, I. J., & Frier, B. M. (1995). Hypoglycemia-induced cognitive dysfunction in diabetes mellitus: Effect of hypoglycemia unawareness. Physiology & Behavior, 58(3), 501–511.
   PubMed Web of Science ®Google Scholar
• Gomes, M. S., Bonan, P. R. F., Ferreira, V. Y. N., de Lucena Pereira, L., Correia, R. J. C., da Silva Teixeira, H. B., … Bonan, P. (2017). Development of a mobile application for oral cancer screening. Technology and Health Care, 25(2), 187–195.
   PubMed Web of Science ®Google Scholar
• Gwaltney, C., Coons, S. J., O’Donohoe, P., O’Gorman, H., Denomey, M., Howry, C., & Ross, J. (2015). “Bring your own device” (BYOD): The future of field-based patient-reported outcome data collection in clinical trials? Therapeutic Innovation & Regulatory Science, 49(6), 783–791.
   PubMed Web of Science ®Google Scholar
• Holtzer, R., Verghese, J., Wang, C., Hall, C. B., & Lipton, R. B. (2008). Within-person across-neuropsychological test variability and incident dementia. The Journal of American Medical Association, 300(7), 823–830.
   PubMed Web of Science ®Google Scholar
• Hultsch, D. F., & MacDonald, S. W. (2004). Intraindividual variability in performance as a theoretical window onto cognitive aging. New Frontiers in Cognitive Aging, 65, 88.
   Google Scholar
• Hyun, J., Sliwinski, M. J., & Smyth, J. M. (2018). Waking up on the wrong side of the bed: The effects of stress anticipation on working memory in daily life. The Journal of Gerontology: Series B.
   Google Scholar
• Insel, T. R. (2017). Digital phenotyping: Technology for a new science of behavior. The Journal of American Medical Association, 318(13), 1215–1216.
   PubMed Web of Science ®Google Scholar
• Iriarte, Y., Diaz-Orueta, U., Cueto, E., Irazustabarrena, P., Banterla, F., & Climent, G. (2016). AULA—Advanced virtual reality tool for the assessment of attention: Normative study in Spain. Journal of Attention Disorders, 20(6), 542–568.
   PubMed Web of Science ®Google Scholar
• Johnson, J. (2013). Designing with the mind in mind: Simple guide to understanding user interface design guidelines. Amsterdam: Elsevier.
   Google Scholar
• Kane, R. L., & Parsons, T. D. (2017). The role of technology in clinical neuropsychology. Oxford: Oxford University Press.
   Google Scholar
• Kassianos, A., Emery, J., Murchie, P., & Walter, F. M. (2015). Smartphone applications for melanoma detection by community, patient and generalist clinician users: A review. British Journal of Dermatology, 172(6), 1507–1518.
   PubMed Web of Science ®Google Scholar
• Koudritzky, M. (2016). A new method to measure touch and audio latency. Retrieved from https://android-developers.googleblog.com/2016/04/a-new-method-to-measure-touch-and-audio.html
   Google Scholar
• Koudritzky, M., Fair, B., Jain, S., Quinn, P., Turner, D., Frysinger, M., & Wimmer, R. (2017). WALT Latency Timer. GitHub.
   Google Scholar
• Lee, J. J., & Chabris, C. F. (2013). General cognitive ability and the psychological refractory period: Individual differences in the mind’s bottleneck. Psychological Science, 24(7), 1226–1233.
   PubMed Web of Science ®Google Scholar
• Long, C. J., & Collins, L. F. (1997). Ecological validity and forensic neuropsychological assessment. In The practice of forensic neuropsychology: Meeting challenges in the courtroom (pp. 153–164). New York: Plenum Press.
   Google Scholar
• McWilliams, T., Reimer, B., Mehler, B., Dobres, J., & Coughlin, J. F. (2015). Effects of age and smartphone experience on driver behavior during address entry: A comparison between a Samsung Galaxy and Apple iPhone. Paper presented at the proceedings of the 7th international conference on automotive user interfaces and interactive vehicular applications.
   Google Scholar
• Min, J.-K., Doryab, A., Wiese, J., Amini, S., Zimmerman, J., & Hong, J. I. (2014). Toss'n'turn: Smartphone as sleep and sleep quality detector. Paper presented at the proceedings of the SIGCHI conference on human factors in computing systems.
   Google Scholar
• Mogg, K., Holmes, A., Garner, M., & Bradley, B. P. (2008). Effects of threat cues on attentional shifting, disengagement and response slowing in anxious individuals. Behaviour Research and Therapy, 46(5), 656–667.
   PubMed Web of Science ®Google Scholar
• Munoz, E., Sliwinski, M. J., Scott, S. B., & Hofer, S. (2015). Global perceived stress predicts cognitive change among older adults. Psychology and Aging, 30(3), 487–499.
   PubMed Web of Science ®Google Scholar
• National Institutes of Health, All of Us Research Program. (2018). All of Us Research Program: Operational Protocol. Retrieved from https://allofus.nih.gov/sites/default/files/aou_operational_protocol_v1.7_mar_2018.pdf
   Google Scholar
• Ng, A., Lepinski, J., Wigdor, D., Sanders, S., & Dietz, P. (2012). Designing for low-latency direct-touch input. Paper presented at the proceedings of the 25th annual ACM symposium on user interface software and technology, Cambridge, MA, USA.
   Google Scholar
• Norman, D. A., & Draper, S. W. (1986). User centered system design: New perspectives on human– computer interaction. Boca Raton, FL: CRC Press.
   Google Scholar
• Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., … Yarkoni, T. (2015). SCIENTIFIC STANDARDS. Promoting an open research culture. Science (New York, NY), 348(6242), 1422–1425.
   Google Scholar
• Onnela, J.-P., & Rauch, S. L. (2016). Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology, 41(7), 1691.
   PubMed Web of Science ®Google Scholar
• OpenSignal. (2015). Android fragmentation visualized. Retrieved from https://opensignal.com/legacy-assets/pdf/reports/2015_08_fragmentation_report.pdf
   Google Scholar
• Overton, M., Pihlsgård, M., & Elmståhl, S. (2016). Test administrator effects on cognitive performance in a longitudinal study of ageing. Cogent Psychology, 3(1), 1260237.
   Web of Science ®Google Scholar
• Redick, T. S., & Engle, R. W. (2006). Working memory capacity and attention network test performance. Applied Cognitive Psychology, 20(5), 713–721.
   Web of Science ®Google Scholar
• Reimers, S., & Stewart, N. (2015). Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript Web experiments. Behavior Research Methods, 47(2), 309–327.
   PubMed Web of Science ®Google Scholar
• Reitan, R. M. (1958). Validity of the trail making test as an indicator of organic brain damage. Perceptual and Motor Skills, 8(3), 271–276.
   Google Scholar
• Riley, E., Esterman, M., Fortenbaugh, F. C., & DeGutis, J. (2017). Time-of-day variation in sustained attentional control. Chronobiology International, 34(7), 993–1001.
   PubMed Web of Science ®Google Scholar
• Schatz, P., Ybarra, V., & Leitner, D. (2015). Validating the accuracy of reaction time assessment on computer-based tablet devices. Assessment, 22(4), 405–410.
   PubMed Web of Science ®Google Scholar
• Siegal, J. (2013a). Here's why typing on Android phones is harder than typing on an iPhone. BGR. Retrieved from bgr.com website: http://bgr.com/2013/09/20/iphone-android-touch-screen-responsiveness/
   Google Scholar
• Siegal, J. (2013b). Study: iPads are the most responsive tablets in the world. Retrieved from http://bgr.com/2013/10/09/tablet-touch-screen-responsiveness/
   Google Scholar
• Sliwinski, M. K., Almeida, D. M., Smyth, J., & Stawski, R. S. (2009). Intraindividual change and variability in daily stress processes: Findings from two measurement burst studies. Psychology and Aging, 24(4), 828.
   PubMed Web of Science ®Google Scholar
• Sliwinski, M. J., Mogle, J. A., Hyun, J., Munoz, E., Smyth, J. M., & Lipton, R. B. (2018). Reliability and validity of ambulatory cognitive assessments. Assessment, 25(1), 14–30.
   PubMed Web of Science ®Google Scholar
• Srnka, K., Seidenberg, M., Hermann, B., & Jones, J. (2018). Intraindividual variability in attentional vigilance in children with epilepsy. Epilepsy & Behavior, 79, 42–45.
   PubMed Web of Science ®Google Scholar
• Susilo, T., Germine, L., & Duchaine, B. (2013). Face recognition ability matures late: Evidence from individual differences in young adults. Journal of Experimental Psychology: Human Perception & Performance, 39(5), 1212–1217.
   PubMed Web of Science ®Google Scholar
• Tsai, H-y. S., Shillair, R., Cotten, S. R., Winstead, V., & Yost, E. (2015). Getting grandma online: Are tablets the answer for increasing digital inclusion for older adults in the US? Educational Gerontology, 41(10), 695–709.
   PubMed Web of Science ®Google Scholar
• Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Bauer, P. J., … Gershon, R. C. (2013). Cognition assessment using the NIH Toolbox. Neurology, 80(11 Suppl. 3), S54–S64.
   PubMed Web of Science ®Google Scholar
• Wilbanks, J., & Friend, S. H. (2016). First, design for data sharing. Nature Biotechnology, 34(4), 377.
   PubMed Web of Science ®Google Scholar
• Woodward, J., Shaw, A., Luc, A., Craig, B., Das, J., Hall, P., Jr, … Brown, Q. (2016). Characterizing how interface complexity affects children's touchscreen interactions. Paper presented at the proceedings of the 2016 CHI conference on human factors in computing systems.
   Google Scholar
• Yun, M. H., He, S., & Zhong, L. (2017). Reducing latency by eliminating synchrony. Paper presented at the proceedings of the 26th international conference on world wide web, Perth, Australia.
   Google Scholar