Design guide and usability questionnaire to develop and assess VIRTRAEL, a web-based cognitive training tool for the elderly

References

• Aizpurua, A., S. Harper, and M. Vigo. 2016. “Exploring the Relationship Between Web Accessibility and User Experience.” International Journal of Human-Computer Studies 91: 13–23. doi:10.1016/j.ijhcs.2016.03.008.
   Web of Science ®Google Scholar
• Akatsu, H., and H. Miki. 2004. “Usability Research for the Elderly People.” Oki Technical Review (Special Issue on Human Friendly Technologies) 71 (3): 54–57.
   Google Scholar
• Åkerlund, E., E. Esbjörnsson, K. S. Sunnerhagen, and A. Björkdahl. 2013. “Can Computerized Working Memory Training Improve Impaired Working Memory, Cognition and Psychological Health?” Brain Injury 27 (13-14): 1649–1657. doi:10.3109/02699052.2013.830195.
   PubMed Web of Science ®Google Scholar
• Arch, A. 2008. “Web Accessibility for Older Users: A Literature Review. W3C Working Draft 14 May 2008.” https://www.w3.org/TR/wai-age-literature/.
   Google Scholar
• Arch, A. 2009a. “Web Accessibility for Older Users: Successes and Opportunities (Keynote).” In Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibility (W4A), edited by Hironobu Takagi, Chieko Asakawa, and David Sloan, 1–6. New York: ACM.
   Google Scholar
• Arch, A., ed. 2009b. “WAI Guidelines and Older Web Users: Findings from a Literature Review.” https://www.w3.org/WAI/WAI-AGE/comparative.html.
   Google Scholar
• Arch, A., and S. Abou-Zhara. 2008. “How Web Accessibility Guidelines Apply to Design for the Ageing Population.” https://www.w3.org/WAI/WAI-AGE/Papers/York_ADDW_waiage_paper.doc.
   Google Scholar
• Baddeley, A. 1992. “Working Memory.” Science 255 (5044): 556–559. doi:10.1126/science.1736359.
   PubMed Web of Science ®Google Scholar
• Becker, S. A. 2004. “A Study of Web Usability for Older Adults Seeking Online Health Resources.” ACM Transactions on Computer-Human Interaction 11 (4): 387–406. doi:10.1145/1035575.1035578.
   Google Scholar
• Bernard, M., C. H. Liao, and M. Mills. 2001. “The Effects of Font Type and Size on the Legibility and Reading Time of Online Text by Older Adults.” In CHI’01 Extended Abstract on Human Factors in Computing System, edited by Marilyn Mantei Tremaine, 175–176. New York: ACM.
   Google Scholar
• Boulton-Lewis, G. M. 2010. “Education and Learning for the Elderly: Why, How, What.” Educational Gerontology 36 (3): 213–228. doi:10.1080/03601270903182877.
   Web of Science ®Google Scholar
• Brewer, J., S. Abou-Zahra, A. Arch, and M. C. Forgue. 2012. “WAI-AGE Project (IST 035015). Web Accessibility Initiative: Ageing Education and Harmonisation (WAI-AGE).” https://www.w3.org/WAI/WAI-AGE/.
   Google Scholar
• Caboral-Stevens, M. 2015. “Theory Development and Pilot Testing of a New Survey Instrument on Usability by Older Adults.” PhD diss., City University of New York. CUNY Academic Works. http://academicworks.cuny.edu/gc_etds/535.
   Google Scholar
• Campbell, O. 2015. “Designing for the Elderly: Ways Older People Use Digital Technology Differently.” https://www.smashingmagazine.com/2015/02/designing-digital-technology-for-the-elderly/.
   Google Scholar
• Castilla, D., C. Botella, I. Miralles, J. Bretón-López, A. M. Dragomir-Davis, I. Zaragoza, and A. García-Palacios. 2018. “Teaching Digital Literacy Skills to the Elderly Using a Social Network with Linear Navigation: A Case Study in a Rural Area.” International Journal of Human-Computer Studies 118: 24–37.
   Web of Science ®Google Scholar
• Castilla, D., A. Garcia-Palacios, I. Miralles, J. Breton-Lopez, E. Parra, S. Rodriguez-Berges, and C. Botella. 2016. “Effect of Web Navigation Style in Elderly Users.” Computers in Human Behavior 55: 909–920. doi:10.1016/j.chb.2015.10.034.
   Web of Science ®Google Scholar
• Chadwick-Dias, A., M. McNulty, and T. Tullis. 2002. “Web Usability and Age: How Design Changes Can Improve Performance.” In ACM SIGCAPH Computers and the Physically Handicapped, 73–74 (June 2002), 30–37. New York: ACM. https://doi.org/10.1145/960201.957212.
   Google Scholar
• Colby, S. L., and J. M. Ortman. 2015. “Projections of the Size and Composition of the U.S. Population: 2014 to 2060.” https://www.census.gov/content/dam/Census/library/publications/2015/demo/p25-1143.pdf.
   Google Scholar
• Connor, L. T. 2001. “Memory in Old Age: Patterns of Decline and Preservation.” Seminars in Speech and Language 22 (2): 119–128.
   Google Scholar
• Costa-Ferrer, M., N. Rando-Hernández, R. Zaragoza-Martín, R. Poveda-Puente, A. Soler-Valero, J. Laparra-Hernández, J. C. García-Ortiz, J. Pla-Civera, and J. M. Bernabé-Gisbert. 2013. “Recommended Guidelines for Developing Video Games and Interfaces for Seniors.” http://gestion.ibv.org/gestoribv/index.php?option=com_docman&view=download&alias=483-guia-senior-play-en&category_slug=productos&Itemid=142.
   Google Scholar
• Costa, A., P. Novais, V. Julian, and G. J. Nalepa. 2018a. “Cognitive Assistants.” International Journal of Human-Computer Studies 117: 1–3. doi:10.1016/j.ijhcs.2018.05.008.
   Web of Science ®Google Scholar
• Costa, L. V., A. I. Veloso, M. Loizou, and S. Arnab. 2018b. “Games for Active Ageing, Well-Being and Quality of Life: A Pilot Study.” Behaviour & Information Technology 37 (8): 842–854. doi:10.1080/0144929X.2018.1485744.
   Web of Science ®Google Scholar
• Díaz-Prieto, C., and J. N. García-Sánchez. 2016. “Psychological Profiles of Older Adult Web 2.0 Tool Users.” Computers in Human Behavior 64: 673–681. doi:10.1016/j.chb.2016.07.007.
   Web of Science ®Google Scholar
• Dickinson, A., J. Arnott, and S. Prior. 2007. “Methods for Human-Computer Interaction Research with Older People.” Behaviour & Information Technology 26 (4): 343–352. doi:10.1080/01449290601176948.
   Web of Science ®Google Scholar
• Dobosz, K., M. Dobosz, T. Fiolka, M. Wojaczek, and T. Depta. 2014. “Tablets in the Rehabilitation of Memory Impairment.” In International Conference on Computers for Handicapped Persons (ICCHP), Lecture Notes in Computer Science, edited by Klaus Miesenberger, Deborah Fels, Dominique Archambault, Petr Peňáz, and Wolfgang Zagler, 399–402. Cham: Springer. vol. 8547.
   Google Scholar
• Doherty, G., D. Coyle, and M. Matthews. 2010. “Design and Evaluation Guidelines for Mental Health Technologies.” Interacting with Computers 22 (4): 243–252. doi:10.1016/j.intcom.2010.02.006.
   Web of Science ®Google Scholar
• EC (European Commission). 2014. “The 2015 Ageing Report: Underlying Assumptions and Projection Methodologies.” http://ec.europa.eu/economy_finance/publications/european_economy/2014/pdf/ee8_en.pdf.
   Google Scholar
• Fernández-López, A., M. J. Rodríguez-Fórtiz, M. L. Rodríguez-Almendros, and M. J. Martínez-Segura. 2013. “Mobile Learning Technology Based on iOS Devices to Support Students with Special Education Needs.” Computers & Education 61: 77–90. doi:10.1016/j.compedu.2012.09.014.
   Web of Science ®Google Scholar
• Fisk, A. D., W. A. Rogers, N. Charness, S. J. Czaja, and J. Sharit. 2009. Designing for Older Adults: Principles and Creative Human Factors Approaches. 2nd ed. Human Factors & Aging Series. Boca Raton, FL: CRC Press.
   Google Scholar
• Fruhling, A., and S. Lee. 2005. “Assessing the Reliability, Validity and Adaptability of PSSUQ.” AMCIS 2005 Proceedings, 378. https://aisel.aisnet.org/amcis2005/378.
   Google Scholar
• González-Abraldes, I., J. C. Millán-Calenti, A. Balo-García, J. Tubío, T. Lorenzo, and A. Maseda. 2010. “Accesibility and Usability of Computer-Based Cognitive Stimulation: Telecognitio.” Revista Española de Geriatría y Gerontología 45 (1): 26–29. doi:10.1016/j.regg.2009.10.005.
   PubMedGoogle Scholar
• Guner, H., and C. Acarturk. 2018. “The Use and Acceptance of ICT by Senior Citizens: A Comparison of Technology Acceptance Model (TAM) for Elderly and Young Adults.” Universal Access in the Information Society 1–20. doi:10.1007/s10209-018-0642-4.
   Web of Science ®Google Scholar
• Hart, T. A., B. S. Chaparro, and C. G. Halcomb. 2008. “Evaluating Websites for Older Adults: Adherence to ‘Senior-Friendly’ Guidelines and End-User Performance.” Behaviour & Information Technology 27 (3): 191–199. doi:10.1080/01449290600802031.
   Web of Science ®Google Scholar
• Hornos, M. J., S. Rute-Pérez, C. Rodríguez-Domínguez, M. L. Rodríguez-Almendros, M. J. Rodríguez-Fórtiz, and A. Caracuel. 2018. “Visual Working Memory Training of the Elderly in VIRTRAEL Personalized Assistant.” In Personal Assistants: Emerging Computational Technologies, edited by A. Costa, V. Julian, and P. Novais, 57–76. Intelligent Systems Reference Library, vol. 132. Cham: Springer.
   Google Scholar
• Jekel, K., M. Damian, C. Wattmo, L. Hausner, R. Bullock, P. J. Connelly, B. Dubois, et al. 2015. “Mild Cognitive Impairment and Deficits in Instrumental Activities of Daily Living: a Systematic Review.” Alzheimer’s Research & Therapy 7: 17. doi:10.1186/s13195-015-0099-0.
   PubMed Web of Science ®Google Scholar
• Kim, J., H. Y. Lee, M. C. Christensen, and J. R. Merighi. 2017. “Technology Access and Use, and Their Associations with Social Engagement Among Older Adults: Do Women and Men Differ?” The Journals of Gerontology: Series B 72 (5): 836–845. doi:10.1093/geronb/gbw123.
   Google Scholar
• Kurniawan, S., and P. Zaphiris. 2005. “Research-Derived Web Design Guidelines for Older People.” In Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS), edited by Andrew Sears and Enrico Pontelli, 129–135. New York: ACM.
   Google Scholar
• López-Martínez, A., S. Santiago-Ramajo, A. Caracuel, C. Valls-Serrano, M. J. Hornos, and M. J. Rodríguez-Fórtiz. 2011. “Game of Gifts Purchase: Computer-Based Training of Executive Functions for the Elderly.” In IEEE 1st International Conference on Serious Games and Applications for Health (SeGAH), edited by Ricardo Simões and Maria Manuela Cruz-Cunha, 1–8. New York: IEEE.
   Google Scholar
• Lynch, K. R., D. J. Schwerha, and G. A. Johanson. 2013. “Development of a Weighted Heuristic for Website Evaluation for Older Adults.” International Journal of Human-Computer Interaction 29 (6): 404–418. doi:10.1080/10447318.2012.715277.
   Web of Science ®Google Scholar
• Mazzuco, S., S. Meggiolaro, F. Ongaro, and V. Toffolutti. 2017. “Living Arrangement and Cognitive Decline Among Older People in Europe.” Ageing and Society 37 (6): 1111–1133. doi:10.1017/S0144686X16000374.
   Web of Science ®Google Scholar
• Merriman, N. A., E. Roudaia, M. Romagnoli, I. Orvieto, and F. N. Newell. 2018. “Acceptability of a Custom-Designed Game, CityQuest, Aimed at Improving Balance Confidence and Spatial Cognition in Fall-Prone and Healthy Older Adults.” Behaviour & Information Technology 37 (6): 538–557. doi:10.1080/0144929X.2018.1462402.
   Web of Science ®Google Scholar
• Morrell, R. W. 2005. “The Process of Construction and Revision in the Development of a Model Web Site for Use by Older Adults.” Universal Access in the Information Society 4 (1): 24–38. doi:10.1007/s10209-003-0085-3.
   Google Scholar
• Murayama, H., Y. Fujiwara, and I. Kawachi. 2012. “Social Capital and Health: A Review of Prospective Multilevel Studies.” Journal of Epidemiology 22 (3): 179–187. doi:10.2188/jea.JE20110128.
   PubMed Web of Science ®Google Scholar
• Nahm, E. S., J. Preece, B. Resnick, and M. E. Mills. 2004. “Usability of Health Web Sites for Older Adults: A Preliminary Study.” CIN: Computers, Informatics, Nursing 22 (6): 326–334. doi:10.1097/00024665-200411000-00007.
   PubMed Web of Science ®Google Scholar
• Nahm, E. S., B. Resnick, and M. E. Mills. 2006. “Development and Pilot-Testing of the Perceived Health Web Site Usability Questionnaire (PHWSUQ) for Older Adults.” Studies in Health Technology and Informatics 122: 38–43.
   PubMedGoogle Scholar
• Newell, A. F., A. Dickinson, M. J. Smith, and P. Gregor. 2006. “Designing a Portal for Older Users: A Case Study of an Industrial/Academic Collaboration.” ACM Transactions on Computer-Human Interaction (TOCHI) 13 (3): 347–375. doi:10.1145/1183456.1183459.
   Google Scholar
• NIA-NLM (National Institute of Aging and National Library of Medicine). 2002. “Making Your Web Site Senior Friendly. A Checklist.” https://www.nlm.nih.gov/pubs/checklist.pdf.
   Google Scholar
• Nielsen, J. 2013. “Seniors as Web Users.” https://www.nngroup.com/articles/usability-for-senior-citizens/.
   Google Scholar
• Njegovan, V., M. Man-Son-Hing, S. L. Mitchell, and F. J. Molnar. 2001. “The Hierarchy of Functional Loss Associated with Cognitive Decline in Older Persons.” The Journals of Gerontology Series A: Biological Sciences and Medical Sciences 56 (10): M638–M643. doi:10.1093/gerona/56.10.M638.
   PubMed Web of Science ®Google Scholar
• Nunes, F., P. A. Silva, and F. Abrantes. 2010. “Human-Computer Interaction and the Older Adult: An Example Using User Research and Personas.” In 3rd International Conference on PErvasive Technologies Related to Assistive Environments (PETRA), Article No. 4. ACM. doi:10.1145/1839294.1839353.
   Google Scholar
• Owen, A. M., A. Hampshire, J. A. Grahn, R. Stenton, S. Dajani, A. S. Burns, R. J. Howard, and C. G. Ballard. 2010. “Putting Brain Training to the Test.” Nature 465 (7299): 775–778. doi:10.1038/nature09042.
   PubMed Web of Science ®Google Scholar
• Patsoule, E., and P. Koutsabasis. 2014. “Redesigning Websites for Older Adults: A Case Study.” Behaviour & Information Technology 33 (6): 561–573. doi:10.1080/0144929X.2013.810777.
   Web of Science ®Google Scholar
• Pierotti, D. 2004. “Heuristic Evaluation - A System Checklist.” Society for Technical Communication. ftp://ftp.cs.uregina.ca/pub/class/305/lab2/example-he.html.
   Google Scholar
• Redish, J., and D. Chisnell. 2004. “Designing Web Sites for Older Adults: A Review of Recent Research.” http://assets.aarp.org/www.aarp.org_/articles/research/oww/AARP-LitReview2004.pdf.
   Google Scholar
• Rivera-Nivar, M., and C. Pomales-García. 2010. “E-training: Can Young and Older Users Be Accommodated with the Same Interface?” Computers & Education 55 (3): 949–960. doi:10.1016/j.compedu.2010.04.006.
   Web of Science ®Google Scholar
• Rodríguez-Domínguez, C., F. Carranza-García, M. L. Rodríguez-Almendros, M. V. Hurtado-Torres, and M. J. Rodríguez-Fórtiz. 2016. “Real Time User Adaptation and Collaboration in Web Based Cognitive Stimulation for Elderly People.” In 13th International Conference Distributed Computing and Artificial Intelligence (DCAI), edited by Sigeru Omatu, Ali Semalat, Grzegorz Bocewicz, Paweł Sitek, Izabela E. Nielsen, Julián A. García García, and Javier Bajo, 367–375. Cham: Springer.
   Google Scholar
• Rodríguez-Fórtiz, M. J., K. Benghazi-Akhlaki, V. Espín-Martín, A. Fernández-López, J. L. Garrido-Bullejos, M. J. Hornos-Barranco, M. V. Hurtado-Torres, et al. 2015. “VIRTRAEL: Virtual Platform for Cognitive Evaluation and Training for the Elderly.” http://virtrael.everyware.es/.
   Google Scholar
• Rodríguez-Fórtiz, M. J., C. Rodríguez-Domínguez, P. Cano, J. Revelles, M. L. Rodríguez-Almendros, M. V. Hurtado-Torres, and S. Rute-Pérez. 2016. “Serious Games for the Cognitive Stimulation of Elderly People.” In IEEE 4th International Conference on Serious Games and Applications for Health (SeGAH), edited by Eva Oliveira Gonçalves, 1–7. Red Hook: IEEE.
   Google Scholar
• Rowe, J. W., and R. L. Kahn. 1997. “Successful Aging.” The Gerontologist 37 (4): 433–440. doi:10.1093/geront/37.4.433.
   PubMed Web of Science ®Google Scholar
• Rowe, J. W., and R. L. Kahn. 2015. “Successful Aging 2.0: Conceptual Expansions for the 21st Century.” The Journals of Gerontology: Series B 70 (4): 593–596. Doi:10.1093/geronb/gbv025.
   Google Scholar
• Rute-Pérez, S., C. Rodríguez-Domínguez, M. J. Rodríguez-Fórtiz, M. V. Hurtado-Torres, and A. Caracuel. 2016. “Training Working Memory in Elderly People with a Computer-Based Tool.” In 15th International Conference on Computers Helping People with Special Needs (ICCHP), edited by Klaus Miesenberger, Christian Bühler, and Petr Penaz, 530–536. Cham: Springer.
   Google Scholar
• Rute-Pérez, S., S. Santiago-Ramajo, M. V. Hurtado, M. J. Rodríguez-Fórtiz, and A. Caracuel. 2014. “Challenges in Software Applications for the Cognitive Evaluation and Stimulation of the Elderly.” Journal of NeuroEngineering and Rehabilitation 11 (88): 1–10. doi:10.1186/1743-0003-11-88.
   PubMedGoogle Scholar
• Sanner, B. M. 2004. “Creating Age-Friendly Websites.” The Journal of Active Aging 3: 20–24. http://www.changingthewayweage.com/Media-and-Marketers-support/Articles/creatingage-friendlywebsites.pdf.
   Google Scholar
• Sayago, S., and J. Blat. 2009. “About the Relevance of Accessibility Barriers in the Everyday Interactions of Older People with the Web.” In International Cross-Disciplinary Conference on Web Accessibility (W4A), edited by Hironobu Takagi, Chieko Asakawa, and David Sloan, 104–113. New York: ACM.
   Google Scholar
• SF (SPRY Foundation). 1999. “Older Adults and the World Wide Web. A Guide for Web Site Creators.” http://www.spry.org/pdf/website_creators_guide.pdf.
   Google Scholar
• Smith, A. 2014. “Older Adults and Technology Use.” Pew Research Center. http://www.pewinternet.org/2014/04/03/older-adults-and-technology-use/.
   Google Scholar
• TRF (The R Foundation). 2009. “The R Project for Statistical Computing.” https://www.r-project.org/.
   Google Scholar
• UN-DESA-PD (United Nations, Department of Economic and Social Affairs, Population Division). 2017. “World Population Prospects: The 2017 Revision. Key Findings and Advance Tables.” Working Paper No. ESA/P/WP/248. https://esa.un.org/unpd/wpp/publications/Files/WPP2017_KeyFindings.pdf.
   Google Scholar
• Vélez-Coto, M., M. J. Rodríguez-Fórtiz, M. L. Rodríguez-Almendros, M. Cabrera-Cuevas, C. Rodríguez-Domínguez, T. Ruiz-López, A. Burgos-Pulido, I. Garrido-Jiménez, and J. Martos-Pérez. 2017. “SIGUEME: Technology-Based Intervention for Low-Functioning Autism to Train Skills to Work with Visual Signifiers and Concepts.” Research in Developmental Disabilities 64: 25–36. doi:10.1016/j.ridd.2017.02.008.
   PubMed Web of Science ®Google Scholar
• Wagner, N., K. Hassanein, and M. Head. 2010. “Computer Use by Older Adults: A Multi-Disciplinary Review.” Computers in Human Behavior 26 (5): 870–882. doi:10.1016/j.chb.2010.03.029.
   Web of Science ®Google Scholar
• Wagner, N., K. Hassanein, and M. Head. 2014. “The Impact of Age on Website Usability.” Computers in Human Behavior 37: 270–282. doi:10.1016/j.chb.2014.05.003.
   Web of Science ®Google Scholar
• Wildenbos, G. A., M. W. M. Jaspers, M. P. Schijven, and L. W. Dusseljee-Peute. 2019. “Mobile Health for Older Adult Patients: Using an Aging Barriers Framework to Classify Usability Problems.” International Journal of Medical Informatics 124: 68–77. doi:10.1016/j.ijmedinf.2019.01.006.
   PubMed Web of Science ®Google Scholar
• Zaphiris, P., M. Ghiawadwala, and S. Mughal. 2005. “Age-Centered Research-Based Web Design Guidelines.” In CHI'05 Extended Abstracts on Human Factors in Computing Systems, edited by Gerrit van der Veer and Carolyn Gale, 1897–1900. New York: ACM.
   Google Scholar
• Zaphiris, P., S. Kurniawan, and M. Ghiawadwala. 2007. “A Systematic Approach to the Development of Research-Based Web Design Guidelines for Older People.” Universal Access in the Information Society 6 (1): 59–75. doi:10.1007/s10209-006-0054-8.
   Google Scholar
• Zaphiris, P., U. Pfeil, and D. Xhixho. 2009. “User Evaluation of Age-Centred Web Design Guidelines.” In International Conference on Universal Access in Human-Computer Interaction (UAHCI), edited by Constantine Stephanidis, 677–686. Berlin: Springer. Lecture Notes in Computer Science, 5614.
   Google Scholar
• Zhao, H. 2001. “Universal Usability Web Design Guidelines for the Elderly (Age 65 and Older).” http://www.co-bw.com/DMS_Web_the_elderly_on_the_web.htm.
   Google Scholar