The Use of Think-Aloud to Evaluate a Navigation Structure for a Multimedia Health and Wellness Application for Older Adults and Their Caregivers

REFERENCES

• Albert, W. & Tullis, T. (2013). Measuring the user experience: Collecting, analyzing, and presenting usability metrics (2nd ed., p. 320). Waltham, MA: Morgan Kaufmann.
   Google Scholar
• Ammenwerth, E., Gräber, S., Herrmann, G., Bürkle, T. & König, J. (2003). Evaluation of health information systems – problems and challenges. International Journal of Medical Informatics, 71(2–3), 125–135. doi:10.1016/S1386-5056(03)00131-X
   PubMed Web of Science ®Google Scholar
• Barnum, C. M. (2010). Usability testing essentials: Ready, set … test! Burlington, MA: Elsevier.
   Google Scholar
• Bendixen, R. M., Horn, K. & Levy, C. (2007). Using telerehabilitation to support elders with chronic illness in their homes. Topics in Geriatric Rehabilitation, 23(1), 47–51. doi:10.1097/00013614-200701000-00007
   Web of Science ®Google Scholar
• Britto, M. T., Jimison, H. B., Munafo, J. K., Wissman, J., Rogers, M. L. & Hersh, W. (2009). Usability testing finds problems for novice users of pediatric portals. Journal of the American Medical Informatics Association: JAMIA, 16(5), 660–669. doi:10.1197/jamia.M3154
   PubMed Web of Science ®Google Scholar
• Catwell, L. & Sheikh, A. (2009). Evaluating eHealth interventions: The need for continuous systemic evaluation. PLoS Medicine, 6(8), e1000126. doi:10.1371/journal.pmed.1000126
   PubMed Web of Science ®Google Scholar
• Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., … Shekelle, P. G. (2006). Systematic review: Impact of health information technology on quality, efficiency, and costs of medical care. Annals of Internal Medicine, 144(10), 742–752. doi:10.7326/0003-4819-144-10-200605160-00125
   PubMed Web of Science ®Google Scholar
• Chou, H.-K., Yan, S.-H., Lin, I.-C., Tsai, M.-T., Chen, C.-C. & Woung, L.-C. (2012). A pilot study of the telecare medical support system as an intervention in dementia care: The views and experiences of primary caregivers. The Journal of Nursing Research: JNR, 20(3), 169–180. doi:10.1097/jnr.0b013e318263d916
   PubMedGoogle Scholar
• Cotton, D. & Gresty, K. (2006). Reflecting on the think-aloud method for evaluating e-learning. British Journal of Educational Technology, 37(1), 45–54. doi:10.1111/j.1467-8535.2005.00521.x
   Web of Science ®Google Scholar
• Demiris, G., Afrin, L. B., Speedie, S., Courtney, K. L., Sondhi, M., Vimarlund, V., … Lynch, C. (2008). Patient-centered applications: Use of information technology to promote disease management and wellness. A white paper by the AMIA knowledge in motion working group. Journal of the American Medical Informatics Association: JAMIA, 15(1), 8–13. doi:10.1197/jamia.M2492
   PubMed Web of Science ®Google Scholar
• Dinapoli, J. M., Garcia-Dia, M. J., Garcia-Ona, L., O'Flaherty, D. & Siller, J. (2014). A theory-based computer mediated communication intervention to promote mental health and reduce high-risk behaviors in the LGBT population. Applied Nursing Research: ANR, 27(1), 91–93. doi:10.1016/j.apnr.2013.10.003
   PubMed Web of Science ®Google Scholar
• Eng, T. R., Gustafson, D. H., Henderson, J., Jimison, H. & Patrick, K.; Science Panel on Interactive Communication, and Health. (1999). Introduction to evaluation of interactive health communication applications. American Journal of Preventive Medicine, 16(1), 10–15. doi:10.1016/s0749-3797(98)00107-x
   PubMed Web of Science ®Google Scholar
• Ericsson, K. A. & Simon, H. A. (1983). Protocol analysis: Verbal reports as data (Revised ed., p. 496). London, United Kingdom: MIT Press.
   Google Scholar
• Gellis, Z. D., Kenaley, B., McGinty, J., Bardelli, E., Davitt, J. & Have, T. T. (2012). Outcomes of a telehealth intervention for homebound older adults with heart or chronic respiratory failure: A randomized controlled trial. Gerontologist, 52(4), 541–552. doi:10.1093/geront/gnr134
   PubMed Web of Science ®Google Scholar
• Hammond, J., Jones, V., Hill, E. L., Green, D. & Male, I. (2014). An investigation of the impact of regular use of the Wii Fit to improve motor and psychosocial outcomes in children with movement difficulties: A pilot study. Child: Care, Health and Development, 40(2), 165–175. doi:10.1111/cch.12029
   PubMed Web of Science ®Google Scholar
• Hordern, A., Georgiou, A., Whetton, S. & Prgomet, M. (2011). Consumer e-health: An overview of research evidence and implications for future policy. Health Information Management Journal, 40(2), 6–14.
   Web of Science ®Google Scholar
• Horsky, J., McColgan, K., Pang, J. E., Melnikas, A. J., Linder, J. A., Schnipper, J. L. & Middleton, B. (2010). Complementary methods of system usability evaluation: Surveys and observations during software design and development cycles. Journal of Biomedical Informatics, 43(5), 782–790. doi:10.1016/j.jbi.2010.05.010
   PubMed Web of Science ®Google Scholar
• Karahasanović, A., Hinkel, U. N., Sjøberg, D. I. K. & Thomas, R. (2009). Comparing of feedback-collection and think-aloud methods in program comprehension studies. Behaviour & Information Technology, 28(2), 139–164. doi:10.1080/01449290701682761
   Web of Science ®Google Scholar
• Kaufman, D. R., Patel, V. L., Hilliman, C., Morin, P. C., Pevzner, J., Weinstock, R. S. & Starren, J. (2003). Usability in the real world: Assessing medical information technologies in patients’ homes. Journal of Biomedical Informatics, 36(1), 45–60. doi:10.1016/s1532-0464(03)00056-x
   PubMed Web of Science ®Google Scholar
• Kjeldskov, J., Skov, M. B. & Stage, J. (2004, October). Instant data analysis: Conducting usability evaluations in a day. Paper presented at the Third Nordic Conference on Human-Computer Interaction, Tampere, Finland.
   Google Scholar
• Koppel, R. (2013). Is healthcare information technology based on evidence? Yearbook of Medical Informatics, 8(1), 7–12.
   PubMedGoogle Scholar
• Lewis, D. (1999). Computer-based approaches to patient education: A review of the literature. Journal of the American Medical Informatics Association, 6(4), 272–282. doi:10.1136/jamia.1999.0060272
   PubMed Web of Science ®Google Scholar
• Logue, M. D. & Effken, J. A. (2012). Modeling factors that influence personal health records adoption. CIN: Computers, Informatics, Nursing, 30(7), 354–362. doi:10.1097/NXN.0b013e3182510717
   PubMed Web of Science ®Google Scholar
• Masters, S., Oliver-Baxter, J., Barton, C., Summers, M., Howard, S., Roeger, L. & Reed, R. (2013). Programmes to support chronic disease self-management: Should we be concerned about the impact on spouses? Health Social Care in the Community, 21, 315–326. doi:10.1111/hsc.12020
   PubMed Web of Science ®Google Scholar
• Nahm, E. S., Blum, K., Scharf, B., Friedmann, E., Thomas, S., Jones, D. & Gottlieb, S. S. (2008). Exploration of patients’ readiness for an eHealth management program for chronic heart failure: A preliminary study. Journal of Cardiovascular Nursing, 23(6), 463–471. doi:10.1097/01.jcn.0000317459.41015.d6
   PubMed Web of Science ®Google Scholar
• Nahm, E.-S., Preece, J., Resnick, B. & Mills, M. E. (2004). Usability of health web sites for older adults. CIN: Computers, Informatics, Nursing, 22(6), 326–334. doi:10.1097/00024665-200411000-00007
   PubMed Web of Science ®Google Scholar
• Nielsen, J. (1993). Usability engineering (p. 362). San Francisco, CA: Morgan Kaufmann.
   Google Scholar
• Nielsen, J. (2012a). Thinking aloud: The #1 usability tool. Retrieved from http://www.nngroup.com/articles/thinking-aloud-the-1-usability-tool/
   Google Scholar
• Nielsen, J. (2012b). Usability 101: Introduction to usability. Retrieved from http://www.nngroup.com/articles/usability-101-introduction-to-usability/
   Google Scholar
• Nielsen, J. & Molich, R. (1990). Heuristic evaluation of user interfaces. Proceedings of the SIGCHI conference on human factors in computing systems Empowering people - CHI ‘90 (pp. 249–256). New York, NY: ACM Press.
   Google Scholar
• Pak, R., Fink, N., Price, M., Bass, B. & Sturre, L. (2012). Decision support aids with anthropomorphic characteristics influence trust and performance in younger and older adults. Ergonomics, 55(9), 1059–1072. doi:10.1080/00140139.2012.691554
   PubMed Web of Science ®Google Scholar
• Pizzi, L. T., Suh, D.-C., Barone, J. & Nash, D. B. (2005). Factors related to physicians’ adoption of electronic prescribing: Results from a national survey. American Journal of Medical Quality, 20(1), 22–32. doi:10.1177/1062860604273775
   PubMed Web of Science ®Google Scholar
• Rubin, J. & Chisnell, D. (2008). Handbook of usability testing: How to plan, design, and conduct effective tests (p. 384). Indianapolis, IN: Wiley.
   Google Scholar
• Samoutis, G., Soteriades, E. S., Kounalakis, D. K., Zachariadou, T., Philalithis, A. & Lionis, C. (2007). Implementation of an electronic medical record system in previously computer-naive primary care centres: A pilot study from Cyprus. Informatics in Primary Care, 15(4), 207–216.
   PubMedGoogle Scholar
• Silva, P. A. & Nunes, F. (2010). 3 × 7 Usability testing guidelines for older adults. 3rd Mexican Workshop on Human Computer Interaction (Vol. 2, pp. 1–8), San Luis Potosi, Mexico.
   Google Scholar
• Stellefson, M., Chaney, B., Barry, A. E., Chavarria, E., Tennant, B., Walsh-Childers, K. & Zagora, J. (2013). Web 2.0 chronic disease self-management for older adults: A systematic review. Journal of Medical Internet Research, 15(2), e35. doi:10.2196/jmir.2439
   PubMed Web of Science ®Google Scholar
• Swierenga, S. J., Abujarad, F., Dennis, T. A. & Post, L. A. (2013). Improving patient safety through user-centered healthcare background check system design. Proceedings of the International Symposium of Human Factors and Ergonomics in Healthcare, 2(1), 21–26. doi:10.1177/2327857913021005
   Google Scholar
• Van Someren, M. W., Barnard, Y. F. & Sandberg, J. A. C. (1994). The think aloud method: A practical guide to modelling cognitive processes. London, United Kingdom: Academic Press.
   Google Scholar
• Wijsman, C. A., Westendorp, R. G., Verhagen, E. A., Catt, M., Slagboom, P. E., de Craen, A. J. & Mooijaart, S. P. (2013). Effects of a web-based intervention on physical activity and metabolism in older adults: Randomized controlled trial. Journal of Medical Internet Research, 15(11), e233. doi:10.2196/jmir.2843
   PubMed Web of Science ®Google Scholar
• Wyatt, J. (2003). When and how to evaluate health information systems? International Journal of Medical Informatics, 69(2–3), 251–259. doi:10.1016/S1386-5056(02)00108-9
   PubMed Web of Science ®Google Scholar
• Yen, P. Y. & Bakken, S. (2012). Review of health information technology usability study methodologies. Journal of the American Medical Informatics Association, 19(3), 413–422. doi:10.1136/amiajnl-2010-000020
   PubMed Web of Science ®Google Scholar