To automate or not to automate: advocating the ‘cliff-edge’ principle

References

• Bainbridge, L. 1983. “Ironies of Automation.” Automatica 19 (6): 775–779. doi:10.1016/0005-1098(83)90046-8.
   Web of Science ®Google Scholar
• Banks, Victoria A., Alexander Eriksson, Jim O’Donoghue, and Neville A. Stanton. 2018. “Is Partially Automated Driving a Bad Idea? Observations from an on-Road Study.” Applied Ergonomics 68: 138–145. doi:10.1016/j.apergo.2017.11.010.
   PubMed Web of Science ®Google Scholar
• Banks, V. A., K. L. Plant, and N. A. Stanton. 2018. “Driver Error or Designer Error: Using the Perceptual Cycle Model to Explore the Circumstances Surrounding the Fatal Tesla Crash on 7th May 2016.” Safety Science 108: 278–285. doi:10.1016/j.ssci.2017.12.023.
   Web of Science ®Google Scholar
• Banks, V. A., and N. A. Stanton. 2016. “Keep the Driver in Control: Automating Automobiles of the Future.” Applied Ergonomics 53(Pt B): 389–395. doi:10.1016/j.apergo.2015.06.020.
   PubMed Web of Science ®Google Scholar
• Billings, C. E. 1991. “Toward a Human-Centred Aircraft Automation Philosophy.” The International Journal of Aviation Psychology 1 (4): 261–270. doi:10.1207/s15327108ijap0104_1.
   Google Scholar
• Boff, K. R. 2006. “Revolutions and Shifting Paradigms in Human Factors & Ergonomics.” Applied Ergonomics 37 (4): 391–399. doi:10.1016/j.apergo.2006.04.003.
   PubMed Web of Science ®Google Scholar
• Borst, C., J. M. Flach, and J. Ellerbroek. 2015. “Beyond Ecological Interface Design: Lessons from Concerns and Misconceptions.” IEEE Transactions on Human-Machine Systems 45 (2): 164–175. doi:10.1109/THMS.2014.2364984.
   Web of Science ®Google Scholar
• Broughton, J., and K. A. Markey. 1996. In-Car Equipment to Help Drivers Avoid Accidents (TRL Report No. 198.). Crowthorne, Berkshire: Transport Research Laboratory.
   Google Scholar
• Cavallo, V., and M. Laurent. 1988. “Visual Information and Skill Level in Time-to-Collision Estimation.” Perception 17 (5): 623–632. doi:10.1068/p170623.
   PubMed Web of Science ®Google Scholar
• Chu, Y., and P. Liu. 2023. “Automation Complacency on the Road.” Ergonomics 2023: 1–20. doi:10.1080/00140139.2023.2210793.
   Web of Science ®Google Scholar
• CIEHF. 2020. The Human Dimension in Tomorrow’s Aviation System. Chartered Institute of Ergonomics and Human Factors. Accessed 26 March 2023. https://ergonomics.org.uk/resource/tomorrows-aviation-system.html.
   Google Scholar
• Dekker, S. 2004. “On the Other Side of Promise: What Should we Automate Today?” In Human Factors for Civil Flight Deck Design, edited by D. Harris, 183–198. Aldershot: Ashgate.
   Google Scholar
• De Winter, J. C. F., S. M. Petermeijer, and D. A. Abbink. 2022. “Shared Control versus Traded Control in Driving: A Debate around Automation Pitfalls.” Ergonomics 2022: 1–27. doi:10.1080/00140139.2022.2153175.
   Web of Science ®Google Scholar
• Endsley, M. R. 1987. “The Application of Human Factors to the Development of Expert Systems for Advanced Cockpits.” Proceedings of the Human Factors Society Annual Meeting 31 (12): 1388–1392. doi:10.1177/154193128703101219.
   Google Scholar
• Endsley, M. R. 2017. “From Here to Autonomy: Lessons Learned from Human-Automation Research.” Human Factors 59 (1): 5–27. doi:10.1177/0018720816681350.
   PubMed Web of Science ®Google Scholar
• Endsley, M. R., and D. B. Kaber. 1999. “Level of Automation Effects on Performance, Situation Awareness and Workload in a Dynamic Control Task.” Ergonomics 42 (3): 462–492. doi:10.1080/001401399185595.
   PubMed Web of Science ®Google Scholar
• Farmer, C. M. 1996. “Effectiveness Estimates for Center High Mounted Stop Lamps: A Six-Year Study.” Accident; Analysis and Prevention 28 (2): 201–208. doi:10.1016/0001-4575(95)00054-2.
   PubMed Web of Science ®Google Scholar
• Gilling, S. P. 1997. “Collision Avoidance, Driver Support and Safety Intervention Systems.” Journal of Navigation 50 (1): 27–32. doi:10.1017/S0373463300023559.
   Web of Science ®Google Scholar
• Grote, G., S. Weik, T. Wafler, and M. Zolch. 1995. “Criteria for the Complementary Allocation of Functions in Automated Work Systems and Their Use in Simultaneous Engineering Projects.” International Journal of Industrial Ergonomics 16 (4–6): 367–382. doi:10.1016/0169-8141(95)00019-D.
   Web of Science ®Google Scholar
• Hancock, P. A. 2014. “Automation: how Much is Too Much?” Ergonomics 57 (3): 449–454. doi:10.1080/00140139.2013.816375.
   PubMed Web of Science ®Google Scholar
• Hancock, P. A. 2017. “Imposing Limits on Autonomous Systems.” Ergonomics 60 (2): 284–291. doi:10.1080/00140139.2016.1190035.
   PubMed Web of Science ®Google Scholar
• Hancock, P. A. 2019. “Some Pitfalls in the Promises of Automated and Autonomous Vehicles.” Ergonomics 62 (4): 479–495. doi:10.1080/00140139.2018.1498136.
   PubMed Web of Science ®Google Scholar
• Hancock, P.A., R. Parasuraman, and E. A Byrne. 1996. “Driver-Centred Issues in Advanced Automation for Motor Vehicles.” In Automation and Human Performance: Theory and Applications edited by R. Parasuraman and M. Mouloua, 337–364. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Kaber, D. B., and M. R. Endsley. 2004. “The Effects of Level of Automation and Adaptive Automation on Human Performance, Situation Awareness and Workload in a Dynamic Control Task.” Theoretical Issues in Ergonomics Science 5 (2): 113–153. doi:10.1080/1463922021000054335.
   Google Scholar
• Kalra, N., and D. G. Groves. 2017. The Enemy of Good: Estimating the Cost of Waiting for Nearly Perfect Automated Vehicles (Report RR2150). Santa Monica, CA: RAND Corporation. Accessed 26 March 2023. https://www.rand.org/content/dam/rand/pubs/research_reports/RR2100/RR2150/RAND_RR2150.pdf.
   Google Scholar
• Lee, J. D., and K. A. See. 2004. “Trust in Automation: Designing for Appropriate Reliance.” Human Factors 46 (1): 50–80. doi:10.1518/hfes.46.1.50_30392.
   PubMed Web of Science ®Google Scholar
• Ljung Aust, M. 2020. How do we know the driver is in the loop? Second Interactive Symposium on Research & Innovation for Connected and Automated Driving in Europe (EUCAD2020). Accessed 26 March 2023. https://www.connectedautomateddriving.eu/_old_wp-content/uploads/2020/09/3.-EUCAD2020-Mikael-Ljung-Aust-How-do-we-know-the-driver-is-in-the-loop.pdf.
   Google Scholar
• Mackworth, N.H. 1948. “The Breakdown of Vigilance During Prolonged Visual Search.” Quarterly Journal of Experimental Psychology, 1: 6–21.
   Web of Science ®Google Scholar
• Mueller, A. S., I. J. Reagan, and J. B. Cicchino. 2021. “Addressing Driver Disengagement and Proper System Use: Human Factors Recommendations for Level 2 Driving Automation Design.” Journal of Cognitive Engineering and Decision Making 15 (1): 3–27. doi:10.1177/1555343420983126.
   Web of Science ®Google Scholar
• Navarro, J., F. Mars, and M. S. Young. 2011. “Lateral Control Assistance in Car Driving: classification, Review and Future Prospects.” IET Intelligent Transport Systems 5 (3): 207–220. doi:10.1049/iet-its.2010.0087.
   Web of Science ®Google Scholar
• Norman, D. A. 1990. “The ‘Problem’ with Automation: inappropriate Feedback and Interaction, Not ‘over-Automation.” Philosophical Transactions of the Royal Society of London 327 (1241): 585–593. doi:10.1098/rstb.1990.0101.
   PubMed Web of Science ®Google Scholar
• Norman, D. A. 2015. “The Human Side of Automation.” In Road Vehicle Automation, edited by G. Meyer and S. Beiker, vol. 2, 73–79. Switzerland: Springer International Publishing.
   Google Scholar
• Noy, I. Y., D. Shinar, and W. J. Horrey. 2018. “Automated Driving: Safety Blind Spots.” Safety Science 102: 68–78. doi:10.1016/j.ssci.2017.07.018.
   Web of Science ®Google Scholar
• Owens, D. A., G. Helmers, and M. Sivak. 1993. “Intelligent Vehicle Highway Systems: A Call for User-Centred Design.” Ergonomics 36 (4): 363–369. doi:10.1080/00140139308967893.
   Web of Science ®Google Scholar
• Parasuraman, R. 1987. “Human-Computer Monitoring.” Human Factors 29 (6): 695–706. doi:10.1177/001872088702900609.
   Web of Science ®Google Scholar
• Parasuraman, R., T. B. Sheridan, and C. D. Wickens. 2000. “A Model for Types and Levels of Human Interaction with Automation.” IEEE Transactions on Systems, Man, and Cybernetics. Part A, Systems and Humans 30 (3): 286–297. doi:10.1109/3468.844354.
   PubMed Web of Science ®Google Scholar
• Reason, J. 1987. “Cognitive Aids in Process Environments: prostheses or Tools?” International Journal of Man-Machine Studies 27 (5–6): 463–470. doi:10.1016/S0020-7373(87)80010-X.
   Google Scholar
• Salmon, P. M., G. H. Walker, and N. A. Stanton. 2016. “Pilot Error versus Sociotechnical Systems Failure: A Distributed Situation Awareness Analysis of Air France 447.” Theoretical Issues in Ergonomics Science 17 (1): 64–79. doi:10.1080/1463922X.2015.1106618.
   Web of Science ®Google Scholar
• Sarter, N. B., and D. D. Woods. 1995. “How in the World Did we Ever Get into That Mode? Mode Error and Awareness in Supervisory Control.” Human Factors 37 (1): 5–19. doi:10.1518/001872095779049516.
   Web of Science ®Google Scholar
• Schutte, P. 1999. “Complemation: An Alternative to Automation.” Journal of Information Technology Impact 1 (3): 113–118.
   Google Scholar
• Selcon, S. J., and R. M. Taylor. 1991. “Decision Support and Situational Awareness.” In Designing for Everyone: Proceedings of the 11th Congress of the International Ergonomics Association, edited by Y. Quéinnec and F. Daniellou, 792–794. London: Taylor & Francis.
   Google Scholar
• Selcon, S. J., R. M. Taylor, and R. A. Shadrake. 1992. “Multi-Modal Cockpit Warnings: Pictures, Words, or Both?” Proceedings of the Human Factors Society Annual Meeting 36 (1): 57–61. doi:10.1177/154193129203600115.
   Google Scholar
• Seong, Y., and A. M. Bisantz. 2008. “The Impact of Cognitive Feedback on Judgment Performance and Trust with Decision Aids.” International Journal of Industrial Ergonomics 38 (7–8): 608–625. doi:10.1016/j.ergon.2008.01.007.
   Web of Science ®Google Scholar
• Seppelt, B. D., and T. W. Victor. 2016. “Potential Solutions to Human Factors Challenges in Road Vehicle Automation.” In Road Vehicle Automation, edited by G. Meyer and S. Beiker, vol. 3, 131–148. Cham, Switzerland: Springer International.
   Google Scholar
• Sheridan, T. B., and W. L. Verplank. 1978. Human and Computer Control of Undersea Teleoperators. Office of Naval Research Report. Cambridge, MA: Massachusetts Institute of Technology. Accessed 26 March 2023. https://apps.dtic.mil/sti/pdfs/ADA057655.pdf.
   Google Scholar
• Stanton, N. A., A. Dunoyer, and A. Leatherland. 2011. “Detection of New in-Path Targets by Drivers Using Stop & Go Adaptive Cruise Control.” Applied Ergonomics 42 (4): 592–601. doi:10.1016/j.apergo.2010.08.016.
   PubMed Web of Science ®Google Scholar
• Stanton, N. A., A. Eriksson, V. A. Banks, and P. A. Hancock. 2020. “Turing in the Driver’s Seat: Can People Distinguish between Automated and Manually Driven Vehicles?” Human Factors and Ergonomics in Manufacturing & Service Industries 30 (6): 418–425. doi:10.1002/hfm.20864.
   Web of Science ®Google Scholar
• Stanton, N. A., and P. Marsden. 1996. “From Fly-by-Wire to Drive-by-Wire: Safety Implications of Automation in Vehicles.” Safety Science 24 (1): 35–49. doi:10.1016/S0925-7535(96)00067-7.
   Web of Science ®Google Scholar
• Stanton, N. A., and M. Pinto. 2000. “Behavioural Compensation by Drivers of a Simulator When Using a Vision Enhancement System.” Ergonomics 43 (9): 1359–1370. doi:10.1080/001401300421806.
   PubMed Web of Science ®Google Scholar
• Stanton, N. A., and P. M. Salmon. 2009. “Human Error Taxonomies Applied to Driving: A Generic Driver Error Taxonomy and Its Implications for Intelligent Transport Systems.” Safety Science 47 (2): 227–237. doi:10.1016/j.ssci.2008.03.006.
   Web of Science ®Google Scholar
• Stanton, N. A., P. M. Salmon, G. H. Walker, E. Salas, and P. A. Hancock. 2017. “State-of-Science: Situation Awareness in Individuals, Teams and Systems.” Ergonomics 60 (4): 449–466. doi:10.1080/00140139.2017.1278796.
   PubMed Web of Science ®Google Scholar
• Stanton, N. A., and M. S. Young. 2005. “Driver Behaviour with Adaptive Cruise Control.” Ergonomics 48 (10): 1294–1313. doi:10.1080/00140130500252990.
   PubMed Web of Science ®Google Scholar
• Stanton, N. A., M. S. Young, G. H. Walker, H. Turner, and S. Randle. 2001. “Automating the Driver’s Control Tasks.” International Journal of Cognitive Ergonomics 5 (3): 221–236. doi:10.1207/S15327566IJCE0503_5.
   Google Scholar
• Wickens, C. D., A. Sebok, H. Li, N. Sarter, and A. M. Gacy. 2015. “Using Modelling and Simulation to Predict Operator Performance and Automation-Induced Complacency with Robotic Automation: A Case Study and Empirical Validation.” Human Factors 57 (6): 959–975. doi:10.1177/0018720814566454.
   PubMed Web of Science ®Google Scholar
• Wiener, E. L., and R. E. Curry. 1980. “Flight-Deck Automation: Promises and Problems.” Ergonomics 23 (10): 995–1011. doi:10.1080/00140138008924809.
   Web of Science ®Google Scholar
• Young, M. S., and G. F. Clynick. 2005. “A Test Flight for Malleable Attentional Resources Theory.” In Contemporary Ergonomics, edited by P. Bust and P. McCabe, vol. 2005, 548–552. London: Taylor & Francis.
   Google Scholar
• Young, M. S., and N. A. Stanton. 1997. “Automotive Automation: Investigating the Impact on Drivers’ Mental Workload.” International Journal of Cognitive Ergonomics 1 (4): 325–336.
   Google Scholar
• Young, M. S., and N. A. Stanton. 2002. “Malleable Attentional Resources Theory: A New Explanation for the Effects of Mental Underload on Performance.” Human Factors 44 (3): 365–375. doi:10.1518/0018720024497709.
   PubMed Web of Science ®Google Scholar
• Young, M. S., N. A. Stanton, and D. Harris. 2007. “Driving Automation: learning from Aviation about Design Philosophies.” International Journal of Vehicle Design 45 (3): 323–338. doi:10.1504/IJVD.2007.014908.
   Web of Science ®Google Scholar
• Young, M. S., and N. A. Stanton. 2023. Driving Automation: A Human Factors Perspective. Boca Raton, FL: CRC Press.
   Google Scholar