Measuring the Usability of Mobile Applications for Phones and Tablets

REFERENCES

• Acemyan, C. Z., Kortum, P., & Shafer, J. (2012). Does the voting environment affect perceived system usability and trust? The relationship between DRE placement within a polling station and voters perceptions of usability, trust, and preference. Paper presented at the 9th Houston Human Factors and Ergonomics Conference, Houston, TX.
   Google Scholar
• Bangor, A., Kortum, P., & Miller, J. A. (2008). The System Usability Scale (SUS): An empirical evaluation. International Journal of Human-Computer Interaction, 24, 574–594. doi:10.1080/10447310802205776
   Web of Science ®Google Scholar
• Bangor, A., Kortum, P., & Miller, J. A. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies, 4, 114–123.
   Google Scholar
• Ben-Zeev, D., Kaiser, S. M., Brenner, C. J., Begale, M., Duffecy, J., & Mohr, D. C. (2013). Development and usability testing of FOCUS: A smartphone system for self-management of schizophrenia. Psychiatric Rehabilitation Journal, 36, 289–296. doi:10.1037/prj0000019
   PubMed Web of Science ®Google Scholar
• Borsci, S., Federici, S., & Lauriola, M. (2009). On the dimensionality of the System Usability Scale: A test of alternative measurement models. Cognitive Processing, 10, 193–197.
   PubMed Web of Science ®Google Scholar
• Brooke, J. (1996). SUS: A ‘quick and dirty’ usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & I. L. McClelland (Eds.), Usability evaluation in industry (pp. 189–194). London, UK: Taylor and Francis.
   Google Scholar
• Byrne, M. D., Greene, K. K., & Everett, S. P. (2007). Usability of voting systems: Baseline data for paper, punch cards, and lever machines. In Proceedings of the SIGCHI conference on human Factors in Computing Systems (pp. 171–180). New York, NY: ACM. doi:10.1145/1240624.1240653
   Google Scholar
• Campbell, B. A., Tossell, C. C., Byrne, M. D., & Kortum, P. (2014). Toward more usable electronic voting: Testing the usability of a smartphone voting system. Human Factors, 56, 973–985. doi:10.1177/0018720813519266
   PubMed Web of Science ®Google Scholar
• Chin, J. P., Diehl, V. A., & Norman, K. L. (1988). Development of an instrument measuring user satisfaction of the human–computer interface. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (pp. 213–218). New York, NY: ACM. doi:10.1145/57167.57203
   Google Scholar
• Çöltekin, A., Heil, B., Garlandini, S., & Fabrikant, S. I. (2009). Evaluating the effectiveness of interactive map interface designs: A case study integrating usability metrics with eye-movement analysis. Cartography and Geographic Information Science, 36, 5–17. doi:10.1559/152304009787340197
   Web of Science ®Google Scholar
• Coursaris, C. K., & Kim, D. J. (2011). A meta-analytical review of empirical mobile usability studies. Journal of Usability Studies, 6, 117–171.
   Google Scholar
• Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 319–340.
   Google Scholar
• Davis, M. R., & Ellis, T. O. (1964). The RAND tablet: A man-machine graphical communication device. In Proceedings of the October 27-29, 1964, fall joint computer conference, part I (pp. 325–331). New York, NY: ACM.
   Google Scholar
• eMarketer. (2015). 2 billion consumers worldwide to get smart(phones) by 2016. Retrieved from http://www.emarketer.com/Article/2-Billion-Consumers-Worldwide-Smartphones-by-2016/1011694
   Google Scholar
• Evans, R. E., & Kortum, P. (2010). The impact of voice characteristics on user response in an interactive voice response system. Interacting with Computers, 22, 606–614. doi:10.1016/j.intcom.2010.07.001
   Web of Science ®Google Scholar
• Finstad, K. (2006). The System Usability Scale and non-native English speakers. Journal of Usability Studies, 1, 185–188.
   Google Scholar
• Flurry Analytics. (2013). The history of app pricing, and why most apps are free. Retrieved from http://www.flurry.com/bid/99013/The-History-of-App-Pricing-And-Why-Most-Apps-Are-Free#.U8WlaPldV8E
   Google Scholar
• Harrison, R., Flood, D., & Duce, D. (2013). Usability of mobile applications: Literature review and rationale for a new usability model. Journal of Interaction Science, 1, 1–16. doi:10.1186/2194-0827-1-1
   Google Scholar
• ISO. (1998). Ergonomic requirements for office work with visual display terminal (VDT’s) – Part 11: guidance on usability (ISO 9241-11(E)). Geneva, Switzerland: International Organization for Standardization.
   Google Scholar
• Kallio, T., & Kaikkonen, A. (2005). Usability testing of mobile applications: A comparison between laboratory and field testing. Journal of Usability Studies, 1, 4–16.
   Google Scholar
• Kangas, E., & Kinnunen, T. (2005). Applying user-centered design to mobile application development. Communications of the ACM, 48(7), 55–59. doi:10.1145/1070838.1070866
   Web of Science ®Google Scholar
• Kascak, L., Rébola, C. B., Braunstein, R., & Sanford, J. (2013). Mobile application concept development for remote patient monitoring. In IEEE International Conference on Healthcare Informatics (pp. 545–550). New York, NY: IEEE. doi:10.1109/ICHI.2013.85
   Google Scholar
• Kirakowski, J., & Cierlik, B. (1998). Measuring the usability of websites. In Proceedings of the Human Factors and Ergonomics Society (pp. 424–428). Santa Monica, CA: HFES. doi:10.1177/154193129804200405
   Google Scholar
• Kirakowski, J., & Corbett, M. (1993). SUMI: The Software Usability Measurement Inventory. British Journal of Educational Technology, 24, 210–212. doi:10.1111/j.1467-8535.1993.tb00076.x
   Web of Science ®Google Scholar
• Kluge, M., & Asche, H. (2012). Validating a smartphone-based pedestrian navigation system prototype. In Proceedings of the 12th international conference on computational science and its applications ICCSA’12 (pp. 386–396). Salvador de Bahia, Brazil: Springer. doi:10.1007/978-3-642-31075-1_29
   Google Scholar
• Kortum, P., & Bangor, A. (2013). Usability ratings for everyday products measured with the System Usability Scale (SUS). International Journal of Human Computer Interaction, 29, 67–76. doi:10.1080/10447318.2012.681221
   Web of Science ®Google Scholar
• Kortum, P., & Johnson, M. (2013). The relationship between levels of user experience with a product and perceived system usability. In Proceedings of the Human Factors and Ergonomics Society (pp. 197–201). Santa Monica, CA: HFES. doi:10.1177/1541931213571044
   Google Scholar
• Lewis, J. R. (1991). An after-scenario questionnaire for usability studies: Psychometric evaluation over three trials. ACM SIGCHI Bulletin, 23(4), 79. doi:10.1145/126729.1056077
   Google Scholar
• Lewis, J. R. (1992). Psychometric evaluation of the Post-Study System Usability Questionnaire: The PSSUQ. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (pp. 1259–1260). Santa Monica, CA: HFES. doi:10.1177/154193129203601617
   Google Scholar
• Lewis, J. R. (1995). IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human‐Computer Interaction, 7, 57–78. doi:10.1080/10447319509526110
   Web of Science ®Google Scholar
• Lewis, J. R., & Sauro, J. (2009). The factor structure of the System Usability Scale. In Human-centered design (pp. 94–103). Berlin, Germany: Springer. doi:10.1007/978-3-642-02806-9_12
   Google Scholar
• Lewis, J. R., Utesch, B. S., & Maher, D. E. (2013). UMUX-LITE: When there’s no time for the SUS. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2099–2102). New York, NY: ACM. doi:10.1145/2470654.2481287
   Google Scholar
• Lund, A. (2001). Measuring usability with the USE questionnaire. Usability Interface: The Usability SIG Newsletter of the Society for Technical Communications, 8(2).
   Google Scholar
• Lutes, K. D., Chang, K., & Baggili, I. M. (2006). Diabetic e-management system (DEMS). In Proceedings of the Third International Conference on Information Technology: New Generations (pp. 619–624). Las Vegas, NV: IEEE. doi:10.1109/ITNG.2006.53
   Google Scholar
• Marcus, A. (2005). User interface design’s return on investment: Examples and statistics. In R. G. Bias & D. J. Mayhew (Eds.), Cost justifying usability: An update for the Internet age (pp. 17–36). Amsterdam, the Netherlands: Elsevier.
   Google Scholar
• McLellan, S., Muddimer, A., & Peres, S. C. (2012). The effect of experience on System Usability Scale ratings. Journal of Usability Studies, 7, 56–67.
   Google Scholar
• Müller, H., Gove, J., & Webb, J. (2012). Understanding tablet use: A multi-method exploration. In Proceedings of the 14th international conference on human–computer interaction with mobile devices and services (pp. 1–10). New York, NY: ACM. doi:10.1145/2371574.2371576
   Google Scholar
• Ng, A. W., Lo, H. W., & Chan, A. H. (2011). Measuring the usability of safety signs: A use of system usability scale (SUS). In Proceedings of the International MultiConference of Engineers and Computer Scientists (Vol. 2, pp. 1296–1301). Hong Kong: IAENG.
   Google Scholar
• Nielsen, J. (1999). Graceful degradation of scalable Internet services, WAP: Wrong approach to portability. Retrieved from http://www.useit.com/alertbox/991031.html
   Google Scholar
• Nielsen Newswire. (2014). Smartphones: So many apps, so much time. Retrieved from http://www.nielsen.com/us/en/insights/news/2014/smartphones-so-many-apps–so-much-time.html
   Google Scholar
• Pew Research. (2014). Mobile technology fact sheet. Retrieved from http://www.pewinternet.org/fact-sheets/mobile-technology-fact-sheet/
   Google Scholar
• Phillips, C., & Chaparro, B. (2009). Visual appeal vs. usability: Which one influences user perceptions of a website more? Usability News, 11(2), 1–9.
   Google Scholar
• Rahmati, A., Tossell, C., Shepard, C., Kortum, P., & Zhong, L. (2012). Exploring iPhone usage: The influence of socioeconomic differences on smartphone adoption, usage and usability. In Proceedings of the 14th international conference on Human-Computer Interaction with Mobile Devices and Services (pp. 11–20). New York, NY: ACM. doi:10.1145/2371574.2371577
   Google Scholar
• Robertson, G., Czerwinski, M., Baudisch, P., Meyers, B., Robbins, D., Smith, G., & Tan, D. (2005). The large-display user experience. IEEE Computer Graphics and Applications, 25(4), 44–51. doi:10.1109/MCG.2005.88
   PubMed Web of Science ®Google Scholar
• Ryu, Y. S., & Smith-Jackson, T. L. (2006). Reliability and validity of the Mobile Phone Usability Questionnaire (MPUQ). Journal of Usability Studies, 2, 39–53.
   Google Scholar
• Sauro, J., & Lewis, J. R. (2009). Correlations among prototypical usability metrics: Evidence for the construct of usability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1609–1618). New York, NY: ACM.
   Google Scholar
• Sauro, J., & Lewis, J. R. (2011). When designing usability questionnaires, does it hurt to be positive? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2215–2224). New York, NY: ACM.
   Google Scholar
• Schmitt, N., & Stults, D. M. (1985). Factors defined by negatively keyed items: The result of careless respondents? Applied Psychological Measurement, 9, 367–373.
   Web of Science ®Google Scholar
• Schriesheim, C. A. (1981). The effect of grouping or randomizing items on leniency response bias. Educational and Psychological Measurement, 41, 401–411.
   Web of Science ®Google Scholar
• Spector, P. E., Van Katwyk, P. T., Brannick, M. T., & Chen, P. Y. (1997). When two factors don’t reflect two constructs: How item characteristics can produce artifactual factors. Journal of Management, 23, 659–677.
   Web of Science ®Google Scholar
• Statista. (2014). Number of apps available in leading app stores as of July 2014. Retrieved from http://www.statista.com/statistics/276623/number-of-apps-available-in-leading-app-stores/
   Google Scholar
• Venkatesh, V., & Davis, F. D. (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46, 186–204.
   Web of Science ®Google Scholar
• Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27, 425–478.
   Web of Science ®Google Scholar
• Wenburg, J., & Wilmont, W. (1973). The personal communication process. New York, NY: Wiley and Sons.
   Google Scholar
• Zhang, D., & Adipat, B. (2005). Challenges, methodologies, and issues in the usability testing of mobile applications. International Journal of Human-Computer Interaction, 18, 293–308. doi:10.1207/s15327590ijhc1803_3
   Web of Science ®Google Scholar