Multi-modal assessment of on-road demand of voice and manual phone calling and voice navigation entry across two embedded vehicle systems

References

• Angell, L., J. Auflick, P. A. Austria, D. Kochhar, L. Tijerina, W. Biever, T. Diptiman, J. Hogsett, and S. Kiger. 2006. Driver Workload Metrics Task 2 Final Report & Appendices. Final Research Report: DOT HS 810 635. Washington, DC: NHTSA/USDOT.
   Google Scholar
• Barón, A., and P. Green. 2006. Safety and Usability of Speech Interfaces for In-vehicle Tasks While Driving: A Brief Literature Review. Ann Arbor, MI: The University of Michigan Transportation Research Institute (UMTRI).
   Google Scholar
• Beckers, N., S. Schreiner, P. Bertrand, B. Reimer, B. Mehler, D. Munger, and J. Dobres. 2014. “Comparing the Demands of Destination Entry Using Google Glass and the Samsung Galaxy S4.” Proceedings of the 58th Annual Meeting of the Human Factors and Ergonomics Society, Chicago, IL, October 27–31.
   Google Scholar
• Blanco, M., W. J. Biever, J. P. Gallagher, and T. A. Dingus. 2006. “The Impact of Secondary Task Cognitive Processing Demand on Driving Performance.” Accident Analysis and Prevention 38: 895–906.10.1016/j.aap.2006.02.015
   PubMed Web of Science ®Google Scholar
• Brookhuis, K. A., G. de Vries, and D. de Waard. 1991. “The Effects of Mobile Telephoning on Driving Performance.” Accident Analysis and Prevention 23 (4): 309–316.10.1016/0001-4575(91)90008-S
   PubMed Web of Science ®Google Scholar
• Brookhuis, K. A., and D. de Waard. 2001. “Assessment of Drivers’ Workload: Performance and Subjective and Physiological Indexes.” In Stress, Workload, and Fatigue, edited by P. A. Hancock and P. A. Desmond, 321–333. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Chiang, D. P., A. M. Brooks, and D. H. Weir. 2005. “Comparison of Visual-manual and Voice Interaction with Contemporary Navigation System HMIs ( Paper No. 2005-01-0433). SAE 2005 World Congress & Exhibition. Warrendale, PA: SAE International.
   Google Scholar
• Collet, C., E. Salvia, and C. Petit-Boulanger. 2014. “Measuring Workload with Electrodermal Activity during Common Braking Actions.” Ergonomics 57 (6): 886–896.10.1080/00140139.2014.899627
   PubMed Web of Science ®Google Scholar
• Conover, W. J., and R. L. Iman. 1981. “Rank Transformations as a Bridge between Parametric and Nonparametric Statistics.” American Statistician 35 (3): 124–129.
   Web of Science ®Google Scholar
• Dopart, C., A. Häggman, C. Thornberry, B. Mehler, J. Dobres, and B. Reimer. 2013. “A Driving Simulation Study Examining Destination Entry with iPhone iOS 5 Google Maps and a Garmin Portable GPS System.” Proceedings of the 57th Annual Meeting of the Human Factors and Ergonomics Society, San Diego, CA, September 30–October 4.
   Google Scholar
• Driver Focus-telematics Working Group. 2006. Statement of Principles, Criteria, and Verification Procedures on Driver-interactions with Advanced In-vehicle Information and Communication Systems. Washington, DC: Alliance of Automobile Manufacturers.
   Google Scholar
• Engström, J., E. Johansson, and J. Östlund. 2005. “Effects of Visual and Cognitive Load in Real and Simulated Motorway Driving.” Transportation Research Part F: Traffic Psychology and Behaviour 8: 97–120.10.1016/j.trf.2005.04.012
   Web of Science ®Google Scholar
• Friedman, M. 1937. “The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance.” Journal of the American Statistical Association 32 (200): 675–701.10.1080/01621459.1937.10503522
   Google Scholar
• Fitch, G. M., S. A. Soccolich, F. Guo, J. McClafferty, Y. Fang, R. L. Olson, M. A. Perez, R. J. Hanowski, J. M. Hankey, and T. A. Dingus. 2013. The Impact of Hand-held and Hands-free Cell Phone Use on Driving Performance and Safety-critical Event Risk. Report No. DOT HS 811 757. Washington, DC: National Highway Traffic Safety Administration.
   Google Scholar
• Garay-Vega, L., A. K. Pradhan, G. Weinberg, B. Schmidt-Nielsen, B. Harsham, Y. Shen, G. Divekar, M. Romoser, M. Knodler, and D. L. Fisher. 2010. “Evaluation of Different Speech and Touch Interfaces to In-vehicle Music Retrieval Systems.” Accident Analysis and Prevention 42: 913–920.10.1016/j.aap.2009.12.022
   PubMed Web of Science ®Google Scholar
• Godthelp, H., P. Milgram, and J. Blaauw. 1984. “The Development of a Time-related Measure to Describe Driving Strategy.” Human Factors 26 (3): 257–268.
   Web of Science ®Google Scholar
• Graham, R., and C. Carter. 2000. “Comparison of Speech Input and Manual Control of In-car Devices While on the Move.” Personal Technologies 4: 155–164.10.1007/BF01324122
   Google Scholar
• Green, P. 1994. Measures and Methods Used to Assess the Safety and Usability of Driver Information Systems. Report No. UMTRI-93-12./FHWA-RD-94-088.
   Google Scholar
• Green, P. 1999a. “The 15-second rule for driver information systems.” In Proceedings of the ITS America Ninth Annual Meeting, Washington, DC, CD-ROM.
   Google Scholar
• Green, P. 1999b. “Estimating Compliance with the 15-second Rule for Driver-interface Usability and Safety.” In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Vol. 43, No. 18, 987–991. Sage.
   Google Scholar
• Haigney, D. E., R. G. Taylor, and S. J. Westerman. 2000. “Concurrent Mobile (Cellular) Phone Use and Driving Performance: Task Demand Characteristics and Compensatory Processes.” Transportation Research Part F: Traffic Psychology and Behaviour 3: 113–121.10.1016/S1369-8478(00)00020-6
   Google Scholar
• Harbluk, J. L., P. C. Burns, M. Lochner, and P. L. Trbovich. 2007. “Using the Lane-change Test (LCT) to Assess Distraction: Tests of Visual-manual and Speech-based Operation of Navigation System Interfaces.” Proceedings of the 4th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, 16–22. Iowa City, IA: University of Iowa Public Policy Center.
   Google Scholar
• Hart, S. G. 2006. “NASA-task Load Index (NASA-TLX); 20 years Later.” In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Vol. 50, No. 9, 904–908. Sage.
   Google Scholar
• Hart, S. G., and L. E. Staveland. 1988. “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.” In Human Mental Workload, edited by P. A. Hancock and N. Meshkati, 139–183. Amsterdam: North Holland Press.
   Google Scholar
• Hendy, K. C., K. M. Hamilton, and L. N. Landry. 1993. “Measuring Subjective Workload: When is One Scale Better than Many?” Human Factors 35 (4): 579–601.
   Web of Science ®Google Scholar
• Hornbæk, K., and E. L. C. Law. 2007. “Meta-analysis of Correlations among Usability Measures.” In Proceedings of the ACM SIGCHI Conference on Human Factors, 617–626. New York: ACM Press.
   Google Scholar
• ISO 15007-1. 2002. Road Vehicles – Measurement of Driver Visual Behaviour with Respect to Transport Information and Control Systems – Part 1: Definitions and Parameters. Geneva: International Standards Organization.
   Google Scholar
• ISO 15007-2. 2001. Road Vehicles – Measurement of Driver Visual Behaviour with Respect to Transport Information and Control Systems – Part 2: Equipment and Procedures. Geneva: International Standards Organization.
   Google Scholar
• Just, M. A., T. A. Keller, and J. Cynkar. 2008. “A Decrease in Brain Activation Associated with Driving When Listening to Someone Speak.” Brain Research 1205: 70–80.10.1016/j.brainres.2007.12.075
   PubMed Web of Science ®Google Scholar
• Klauer, S. G., T. A. Dingus, V. L. Neale, J. D. Sudweeks, and D. J. Ramsey. 2006. The Impact of Driver Inattention on Near-crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data ( DOT HS-810-594). Washington, DC: National Highway Traffic Safety Administration.
   Google Scholar
• Kramer, A. E. 1991. “Physiological Metrics of Mental Workload: A Review of Recent Progress.” In Multiple-task Performance, edited by D. L. Damos, 279–328. London: Taylor & Francis.
   Google Scholar
• Kubose, T. T., K. Bock, G. S. Dell, S. M. Garnsey, A. F. Kramer, and J. Mayhugh. 2006. “The Effects of Speech Production and Speech Comprehension on Simulated Driving Performance.” Applied Cognitive Psychology 20: 43–63.10.1002/(ISSN)1099-0720
   Web of Science ®Google Scholar
• Lee, J. D., B. Caven, S. Haake, and T. L. Brown. 2001. “Speech-based Interaction with In-vehicle Computers: The Effect of Speech-based E-Mail on Drivers’ Attention to the Roadway.” Human Factors: The Journal of the Human Factors and Ergonomics Society 43 (4): 631–640.10.1518/001872001775870340
   PubMed Web of Science ®Google Scholar
• Lenneman, J. K., and R. W. Backs. 2010. “Enhancing Assessment of In-vehicle Technology Attention Demands with Cardiac Measures.” In Proceedings of the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 20–21. New York: ACM Press.
   Google Scholar
• Liu, Y. C., C. S. Schreiner, and T. A. Dingus. 1999. Development of Human Factors Guidelines for Advanced Traveler Information Systems (ATIS) and Commercial Vehicle Operations (CVO): Human Factors Evaluation of the Effectiveness of Multi-modality Displays in Advanced Traveler Information Systems ( No. FHWA-RD-96-150).
   Google Scholar
• Lo, V. E.-W., and P.A. Green. 2013. “Development and Evaluation of Automotive Speech Interfaces: Useful Information from the Human Factors and the Related Literature.” International Journal of Vehicular Technology 2013, 13 p. doi:10.1155/2013/924170.
   Google Scholar
• Maciej, J., and M. Vollrath. 2009. “Comparison of Manual vs. Speech-based Interaction with In-vehicle Information Systems.” Accident Analysis and Prevention 41: 924–930.10.1016/j.aap.2009.05.007
   PubMed Web of Science ®Google Scholar
• McDonald, W. A., and E. R. Hoffman. 1980. “Review of Relationships between Steering Wheel Reversal Rate and Driving Task Demand.” Human Factors 22 (6): 733–739.
   Web of Science ®Google Scholar
• Mehler, B., B. Reimer, and J. F. Coughlin. 2012. “Sensitivity of Physiological Measures for Detecting Systematic Variations in Cognitive Demand from a Working Memory Task: An On-road Study across Three Age Groups.” Human Factors: The Journal of the Human Factors and Ergonomics Society 54 (3): 396–412.10.1177/0018720812442086
   PubMed Web of Science ®Google Scholar
• Mehler, B., B. Reimer, J. F. Coughlin, and J. A. Dusek. 2009. “Impact of Incremental Increases in Cognitive Workload on Physiological Arousal and Performance in Young Adult Drivers.” Transportation Research Record: Journal of the Transportation Research Board 2138: 6–12.10.3141/2138-02
   Web of Science ®Google Scholar
• Mehler, B., B. Reimer, J. Dobres, H. McAnulty, A. Mehler, D. Munger, and J. F. Coughlin. 2014. Further Evaluation of the Effects of a Production Level “voice-command” Interface on Driver Behavior: Replication and a Consideration of the Significance of Training Method ( MIT AgeLab Technical Report No. 2014-2). Cambridge, MA: Massachusetts Institute of Technology.
   Google Scholar
• Mulder, L. J. 1992. “Measurement and Analysis Methods of Heart Rate and Respiration for Use in Applied Environments.” Biological Psychology 34 (2–3): 205–236.10.1016/0301-0511(92)90016-N
   PubMed Web of Science ®Google Scholar
• Munger, D., B. Mehler, B. Reimer, J. Dobres, A. Pettinato, B. Pugh, and J. F. Coughlin. 2014. “A Simulation Study Examining Smartphone Destination Entry While Driving.” Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicle Applications (AutoUI 2014), Seattle, WA, September 17–19.
   Google Scholar
• NHTSA (National Highway Traffic Safety Administration). 2013. Visual-manual NHTSA Driver Distraction Guidelines for In-vehicle Electronic Devices (Docket No. NHTSA-2010-0053). Washington, DC: U.S. Department of Transportation National Highway Traffic Safety Administration (NHTSA).
   Google Scholar
• Nielsen, J., and J. Levy. 1994. “Measuring Usability: Preference vs. Performance.” Communications of the ACM 37 (4): 66–75.10.1145/175276.175282
   Web of Science ®Google Scholar
• Noy, Y. I. 1990. Attention and Performance While Driving with Auxiliary In-vehicle Displays ( Transport Canada Publication TP 10727 (E)). Ottawa: Transport Canada, Traffic Safety Standards and Research, Ergonomics Division.
   Google Scholar
• Östlund, J., L. Nilsson, O. Carsten, N. Merat, S. Jamson, W. Janssen, S. Mouta, J. Carvalhais, J. Santos, V. Anttila, H. Sandberg, D. Luoma, de Waard, K. Brookhuis, E. Johansson, J. Engström, T. Victor, J. Harbluk, W. Janssen, and R. Brouwer. 2004. Deliverable 2—HMI and Safety-related Driver Performance. Human Machine Interface and the Safety of Traffic in Europe (HASTE) Project. Report No. GRD1/2000/25361 S12.319626.
   Google Scholar
• Östlund, J., B. Peters, B. Thorslund, J. Engström, G. Markkula, A. Keinath, D. Horst, S. Juch, S. Mattes, and U. Foehl. 2005. Adaptive Integrated Driver-vehicle Interface (AIDE): Driving Performance Assessment – Methods and Metrics. Report No. IST-1-507674-IP. Gothenburg: Information Society Technologies (IST) Programme.
   Google Scholar
• Owens, J. M., S. B. McLaughlin, and J. Sudweeks. 2010. “On-road Comparison of Driving Performance Measures When Using Handheld and Voice-control Interfaces for Mobile Phones and Portable Music Players ( Paper No. 2010-01-1036). SAE 2010 World Congress & Exhibition. Warrendale, PA: SAE International.
   Google Scholar
• Owens, J. M., S. B. McLaughlin, and J. Sudweeks. 2011. “Driver Performance While Text Messaging Using Handheld and In-vehicle Systems.” Accident Analysis & Prevention 43: 939–947.
   PubMed Web of Science ®Google Scholar
• Patten, C. J. D., A. Kircher, J. Östlund, and L. Nilsson. 2004. “Using Mobile Telephones: Cognitive Workload and Attention Resource Allocation.” Accident Analysis and Prevention 36: 341–350.10.1016/S0001-4575(03)00014-9
   PubMed Web of Science ®Google Scholar
• R Core Team. 2014. R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
   Google Scholar
• Ranney, T. A., J. L. Harbluk, and Y. I. Ian Noy. 2005. “Effects of Voice Technology on Test Track Driving Performance: Implications for Driver Distraction.” Human Factors: The Journal of the Human Factors and Ergonomics Society 47 (2): 439–454.10.1518/0018720054679515
   PubMed Web of Science ®Google Scholar
• Reagan, I. J., and D. G. Kidd. 2013. “Using Heirarchical Task Analysis to Compare Four Vehicle Manufacturers’ Infotainment Systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 1495–2599, Santa Monica, CA: Human Factors and Ergonomics Society.
   Google Scholar
• Recarte, M. A., and L. M. Nunes. 2000. “Effects of Verbal and Spatial-imagery Tasks on Eye Fixations While Driving.” Journal of Experimental Psychology Applied 6 (1): 31–43.10.1037/1076-898X.6.1.31
   PubMed Web of Science ®Google Scholar
• Reimer, B., P. Gruevski, and J. F. Coughlin. 2014. MIT AgeLab Video Annotator. Cambridge, MA. https://bitbucket.org/agelab/annotator.
   Google Scholar
• Reimer, B., and B. Mehler. 2011. “The Impact of Cognitive Workload on Physiological Arousal in Young Adult Drivers: A Field Study and Simulation Validation.” Ergonomics 54 (10): 932–942.10.1080/00140139.2011.604431
   PubMed Web of Science ®Google Scholar
• Reimer, B., and B. Mehler. 2013. The Effects of a Production Level “voice-command” Interface on Driver Behavior: Summary Findings on Reported Workload, Physiology, Visual Attention, and Driving Performance ( White Paper 2013-18A). Cambridge, MA: Massachusetts Institute of Technology AgeLab. http://web.mit.edu/reimer/www/pdfs/MIT_AgeLab_White_Paper_2013-18A_(Voice_Interfaces).pdf.
   Google Scholar
• Reimer, B., B. Mehler, J. Dobres, and J. F. Coughlin. 2013. The Effects of a Production Level “voice-command” Interface on Driver Behavior: Reported Workload, Physiology, Visual Attention, and Driving Performance. MIT AgeLab Technical Report No. 2013-17A. Cambridge, MA: Massachusetts Institute of Technology.
   Google Scholar
• Reimer, B., B. Mehler, J. Dobres, H. McAnulty, A. Mehler, D. Munger, and A. Rumpold. 2014. “Effects of an ‘expert mode’ Voice Command System on Task Performance, Glance Behavior & Driver Physiology.” Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutoUI 2014), Seattle, WA, September 17–19.
   Google Scholar
• Reimer, B., B. Mehler, I. Reagan, D. Kidd, and J. Dobres. 2015. “Multi-modal Demands of a Smartphone Used to Place Calls and Enter Addresses during Highway Driving Relative to Two Embedded Systems.” Manuscript under review. Ergonomics.
   PubMed Web of Science ®Google Scholar
• Reimer, B., B. Mehler, Y. Wang, and J. F. Coughlin. 2012. “A Field Study on the Impact of Variations in Short-term Memory Demands on Drivers’ Visual Attention and Driving Performance across Three Age Groups.” Human Factors: The Journal of the Human Factors and Ergonomics Society 54 (3): 454–468.10.1177/0018720812437274
   PubMed Web of Science ®Google Scholar
• Roscoe, A. H. 1992. “Assessing Pilot Workload. Why Measure Heart Rate, HRV and Respiration?” Biological Psychology 34 (2–3): 259–287.10.1016/0301-0511(92)90018-P
   PubMed Web of Science ®Google Scholar
• SAE. 2004. Navigation and Route Guidance Function Accessibility While Driving (SAE J2364). Warrendale, PA: SAE International.
   Google Scholar
• Schreiner, C. S., M. Blanco, and J. Hankey. 2004. “Investigating the Effect of Performing Voice Recognition Tasks on the Detection of Forward and Peripheral Events.” Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting, Santa Monica, CA, September, 2004, 2354–2358.
   Google Scholar
• Shutko, J., K. Mayer, E. Laansoo, and L. Tijerina. 2009. “Driver Workload Effects of Cell Phone, Music Player, and Text Messaging Tasks with the Ford SYNC Voice Interface versus Handheld Visual-manual Interfaces.” ( Paper No. 2009-01-0786). SAE 2009 World Congress & Exhibition. Warrendale, PA: SAE International.
   Google Scholar
• Smith, D. L., J. Chang, R. Glassco, J. Foley, and D. Cohen. 2005. “Methodology for Capturing Driver Eye Glance Behavior During In-vehicle Secondary Tasks.” Transportation Research Record: Journal of the Transportation Research Board 1937 (1): 61–65.10.3141/1937-09
   Google Scholar
• Solovey, E., M. Zeck, E. A. Garcia-Perez, B. Reimer, and B. Mehler. 2014. “Classifying Driver Workload Using Physiological and Driving Performance Data: Two Field Studies.” Proceedings of the 32nd Annual Conference on Human Factors in Computing Systems (CHI 2014), Toronto, Canada, April 26–May 1, 4057–4066.
   Google Scholar
• Strayer, D. L., J. M. Cooper, J. Turrill, J. Coleman, N. Medeiros-Ward, and F. Biondi. 2013. Measuring Cognitive Distraction in the Automobile. Washington, DC: AAA Foundation for Traffic Safety.
   Google Scholar
• Strayer, D. L., F. A. Drews, and W. A. Johnston. 2003. “Cell Phone-induced failures of Visual Attention during Simulated Driving.” Journal of Experimental Psychology: Applied 9 (1): 23–32.
   PubMed Web of Science ®Google Scholar
• Strayer, D. L., J. Turrill, J. R. Coleman, E. V. Ortiz, and J. M. Cooper. 2014. Measuring Cognitive Distraction in the Automobile II: Assessing In-vehicle Voice-based Interactive Technologies. Washington, DC: AAA Foundation for Traffic Safety.
   Google Scholar
• Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. 1996. “Heart Rate Variability: Standards of Measurement, Physiological Interpretation, and Clinical Use.” European Heart Journal 17: 354–381.
   PubMed Web of Science ®Google Scholar
• Tsimhoni, O., D. Smith, and P. Green. 2004. “Address Entry While Driving: Speech Recognition versus a Touch-screen Keyboard.” Human Factors: The Journal of the Human Factors and Ergonomics Society 46 (4): 600–610.10.1518/hfes.46.4.600.56813
   PubMed Web of Science ®Google Scholar
• Veltman, J. A., and A. W. K. Gaillard. 1998. “Physiological Workload Reactions to Increasing Levels of Task Difficulty.” Ergonomics 41 (5): 656–669.10.1080/001401398186829
   PubMed Web of Science ®Google Scholar
• Victor, T., J. Bärgman, C. Boda, M. Dozza, J. Engström, C. Flannagan, J. D. Lee, and G. Markkula. 2014. Analysis of Naturalistic Driving Study Data: Safer Glances, Driver Inattention, and Crash Risk. ( SHRP 2 Safety Project S08A Prepublication Draft). Gothenburg: Safer Vehicle and Traffic Safety Centre at Chalmers.
   Google Scholar
• Wilson, G. F. 2002. “Psychophysiological Test Methods and Procedures.” In Handbook of Human Factors Testing and Evaluation, edited by S. G. Charlton and T. G. O’Brien, 127–156. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar