Automation in visual inspection tasks: X-ray luggage screening supported by a system of direct, indirect or adaptable cueing with low and high system reliability

References

• Baeriswyl, S., A. Krause, and A. Schwaninger. 2016. “Emotional Exhaustion and Job Satisfaction in Airport Security Officers – Work-Family Conflict as Mediator in the Job Demands-Resources Model.” Frontiers in Psychology 7: 663. doi:10.3389/fpsyg.2016.00663
   PubMed Web of Science ®Google Scholar
• Bailey, N. R., and M. W. Scerbo. 2007. “Automation-Induced Complacency for Monitoring Highly Reliable Systems: The Role of Task Complexity, System Experience, and Operator Trust.” Theoretical Issues in Ergonomics Science 8 (4): 321–348. doi:10.1080/14639220500535301.
   Google Scholar
• Brainard, D. H. 1997. “The Psychophysics Toolbox.” Spatial Vision 10: 433–436. doi:10.1163/156856897X00357
   PubMedGoogle Scholar
• Chavaillaz, A., D. Wastell, and J. Sauer. 2016a. “Effects of Extended Lay-off Periods on Performance and Operator Trust Under Adaptable Automation.” Applied Ergonomics 53( Pt A): 241–251. doi:10.1016/j.apergo.2015.10.006
   PubMed Web of Science ®Google Scholar
• Chavaillaz, A., D. Wastell, and J. Sauer. 2016b. “System Reliability, Performance and Trust in Adaptable Automation.” Applied Ergonomics 52: 333–342. doi:10.1016/j.apergo.2015.07.012
   PubMed Web of Science ®Google Scholar
• Drury, C. G. 1975. “Inspection of Sheet Materials – Model and Data.” Human Factors 17 (3): 257–265. doi:10.1177/001872087501700305.
   PubMed Web of Science ®Google Scholar
• Drury, C. G. 1992. “Inspection Performance.” In Handbook of Industrial Engineering, edited by Gavriel Salvendy. 2nd ed., 2282–2314. New York: Wiley.
   Google Scholar
• Drury, C. G. 2001. “Human Factors and Automation in Test and Inspection.” In Handbook of Industrial Engineering: Technology and Operations Management, edited by Gavriel Salvendy. 3rd ed., 1887–1920. New York: John Wiley.
   Google Scholar
• Dzindolet, M. T., S. A. Peterson, R. A. Pomranky, L. G. Pierce, and H. P. Beck. 2003. “The Role of Trust in Automation Reliance.” International Journal of Human-Computer Studies 58 (6): 697–718. doi:10.1016/S1071-5819(03)00038-7.
   Web of Science ®Google Scholar
• Goh, J., D. A. Wiegmann, and P. Madhavan. 2005. “Effects of Automation Failure in a Luggage Screening Task: A Comparison Between Direct And Indirect Cueing.” In Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society. Vol. 49, 492–496. Orlando, FL: SAGE Publications. doi:10.1177/154193120504900359
   Google Scholar
• Green, D. M., and J. A. Swets. 1966. Signal Detection Theory and Psychophysics. New-York, NY: Wiley.
   Google Scholar
• Hardmeier, D., F. Hofer, and A. Schwaninger. 2005. “The X-ray object recognition test (X-ray ORT)-a reliable and valid instrument for measuring visual abilities needed in X-ray screening.” Paper presented at the Proceedings of the 39th IEEE Carnahan Conference on Security Technology, 189–92. Las Palmas, Spain. doi:10.1109/CCST.2005.1594876.
   Google Scholar
• Harris, D. H. 2002. “How to Really Improve Airport Security.” Ergonomics in Design: The Quarterly of Human Factors Applications 10 (1): 17–22. doi:10.1177/106480460201000104.
   Google Scholar
• Hart, S.G., and L.E. Staveland. 1988. “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.” In Human Mental Workload. Vol. 52 of Advances in Psychology, edited by Peter A. Hancock and Najmedin Meshkati, 139–383. Amsterdam: North-Holland.
   Google Scholar
• I nagaki, T. 2003. “Adaptive Automation: Sharing and Trading of Control.” In Handbook of Cognitive Task Design. Series: Human Factors and Ergonomics, edited by Erik Hollnagel, 221–245.. Mahwah: Lawrence Erlbaum Publishers.
   Google Scholar
• Jian, J.-Y., A. M. Bisantz, and C. G. Drury. 2000. “Foundations for an Empirically Determined Scale of Trust in Automated Systems.” International Journal of Cognitive Ergonomics 4 (1): 53–71. doi:10.1207/S15327566IJCE0401_04.
   Google Scholar
• Kaber, D. B., and J. M. Riley. 1999. “Adaptive Automation of a Dynamic Control Task Based on Secondary Task Workload Measurement.” International Journal of Cognitive Ergonomics 3 (3): 169–187. doi:10.1207/s15327566ijce0303_1
   Google Scholar
• Karasek, R., and T. Theorell. 1990. Healthy Work: Stress Productivity and the Reconstruction of Working Life. 1st ed. New York: Basic Books.
   Google Scholar
• Kidwell, B., G. L. Calhoun, H. A. Ruff, and R. Parasuraman. 2012. “Adaptable and Adaptive Automation for Supervisory Control of Multiple Autonomous Vehicles.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56 (1): 428–432. doi:10.1177/1071181312561096.
   Google Scholar
• Kleiner, M., D. Brainard, D. Pelli, A. Ingling, R. Murray, and C. Broussard. 2007. “What’s New in Psychtoolbox-3.” Perception 36 (14): 1.
   Google Scholar
• Koller, S. M., C. G. Drury, and A. Schwaninger. 2009. “Change of search time and non-search time in X-ray baggage screening due to training.” Ergonomics 52 (6): 644–656. doi:10.1080/0014013080526.
   PubMed Web of Science ®Google Scholar
• Lee, J. D., and N. Moray. 1992. “Trust, Control Strategies and Allocation of Function in Human-Machine Systems.” Ergonomics 35 (10): 1243–1270. doi:10.1080/00140139208967392.
   PubMed Web of Science ®Google Scholar
• Lee, J. D., and F. Sanquist. 1996. “Maritime Automation.” In Automation and Human Performance: Theory and Applications. Series: Human Factors in Transportation, edited by Raja Parasuraman and Mustapha Mouloua, 365–384. Mahwah, NJ: Erlbaum.
   Google Scholar
• Ma, R., and D. B. Kaber. 2007. “Effects of In-Vehicle Navigation Assistance and Performance on Driver Trust and Vehicle Control.” International Journal of Industrial Ergonomics 37 (8): 665–673. doi:10.1016/j.ergon.2007.04.005.
   Web of Science ®Google Scholar
• Macmillan, N. A., and C. D. Creelman. 2005. Detection Theory: A User’s Guide. 1st ed. Mahwah, NJ: Psychology Press.
   Google Scholar
• McCarley, J. S., A. F. Kramer, C. D. Wickens, E. D. Vidoni, and W. R. Boot. 2004. “Visual Skills in Airport-Security Screening.” Psychological Science 15 (5): 302–306. doi:10.1111/j.0956-7976.2004.00673.x.
   PubMed Web of Science ®Google Scholar
• McCarley, J. S., D. A. Wiegmann, C. D. Wickens, and A. F. Kramer. 2003. “Effects of Age on Utilization and Perceived Reliability of an Automated Decision-Making Aid for Luggage Screening.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 47 (3): 340–343. doi:10.1177/154193120304700319.
   Google Scholar
• Mery, D., G. Mondragon, V. Riffo, and I. Zuccar. 2013. “Detection of Regular Objects in Baggage Using Multiple X-ray Views.” Insight - Non-Destructive Testing and Condition Monitoring 55 (1): 16–20. doi:10.1784/insi.2012.55.1.16.
   Google Scholar
• Meyer, J. 2001. “Effects of Warning Validity and Proximity on Responses to Warnings.” Human Factors 43 (4): 563–572. doi:10.1518/001872001775870395.
   PubMed Web of Science ®Google Scholar
• Michel, S., N. Hattenschwiler, M. Kuhn, N. Strebel, and A. Schwaninger. 2014. “A Multi-Method Approach Towards Identifying Situational Factors and their Relevance for X-ray Screening.” Paper presented at the International Carnahan Conference on Security Technology (ICCST). October 13-16. Rome, Italy. doi:10.1109/CCST.2014.6987001.
   Google Scholar
• Onnasch, L. 2015. “Crossing the Boundaries of Automation—Function Allocation and Reliability.” International Journal of Human-Computer Studies 76: 12–21. doi:10.1016/j.ijhcs.2014.12.004
   Web of Science ®Google Scholar
• Parasuraman, R., R. Molloy, and I. L. Singh. 1993. “Performance Consequences of Automation-Induced ‘Complacency’.” The International Journal of Aviation Psychology 3 (1): 1–23. doi:10.1207/s15327108ijap0301_1.
   Google Scholar
• Parasuraman, R., M. Mouloua, R. Molloy, and B. Hilburn. 1993. “Adaptive Function Allocation Reduces Performance Costs of Static Automation.” In 7th International Symposium on Aviation Psychology, edited by Richard S. Jensen and David Neumeister, 178–185. Columbus: Ohio State University.
   Google Scholar
• Pelli, D. G. 1997. “The VideoToolbox Software for Visual Psychophysics: Transforming Numbers into Movies.” Spatial vision 10 (4): 437–442. doi:10.1163/156856897X00366
   PubMedGoogle Scholar
• Rice, S., and J. S. McCarley. 2011. “Effects of Response Bias and Judgment Framing on Operator Use of an Automated Aid in a Target Detection Task.” Journal of Experimental Psychology: Applied 17 (4): 320–331. doi:10.1037/a0024243.
   PubMed Web of Science ®Google Scholar
• Roomi, M. M., and R. Rajashankari. 2012. “Detection of Concealed Weapons in X-ray Images Using Fuzzy K-NN.” International Journal of Computer Science, Engineering and Information Technology 2 (2): 187–196. doi:10.5121/ijcseit.2012.2216.
   Google Scholar
• Rovira, E., K. McGarry, and R. Parasuraman. 2007. “Effects of Imperfect Sutomation on Decision Making in a Simulated Command and Control Task.” Human Factors 49 (1): 76–87. doi:10.1518/001872007779598082.
   PubMed Web of Science ®Google Scholar
• Sanchez, J., A. D. Fisk, and W. A. Rogers. 2004. “Reliability and Age-Related Effects on Trust and Reliance of a Decision Support Aid.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 48 (3): 586–589. doi:10.1177/154193120404800366.
   Google Scholar
• Sauer, J., and A. Chavaillaz. 2017. “How Operators Make Use of Wide-Choice Adaptable Automation: Observations from a Series of Experimental Studies.” Theoretical Issues in Ergonomics Science, 1–21. doi:10.1080/1463922X.2017.1297866.
   Web of Science ®Google Scholar
• Sauer, J., A. Chavaillaz, and D. Wastell. 2017. “Experience of Automation Failures in Training: Effects on Trust, Automation Bias, Complacency and Performance.” Ergonomics 73 (9): 1–14. doi:10.1080/00140139.2015.1094577.
   Web of Science ®Google Scholar
• Sauer, J., C.-S. Kao, and D. Wastell. 2012. “A comparison of adaptive and adaptable automation under different levels of environmental stress.” Ergonomics 55 (8): 840–853. doi:10.1080/00140139.2012.676673.
   PubMed Web of Science ®Google Scholar
• Scerbo, M. W. 2006. “Dynamic Function Allocation.” In International Encyclopedia of Ergonomics and Human Factors, edited by Waldemar Karwowski. 2nd ed., 1080–82. Boca Raton, FL: Taylor & Francis.
   Google Scholar
• Schwaninger, A., A. Bolfing, T. Halbherr, S. Helman, A. Belyavin, and L. Hay. 2008. “The impact of image based factors and training on threat detection performance in X-ray screening.” Paper presented at the Proceedings of the 3rd International Conference on Research in Air Transportation, ICRAT, June 1-4. Fairfax, VA, 317-324. doi:10.13140/RG.2.1.1299.3526.
   Google Scholar
• Schwaninger, A., D. Hardmeier, and F. Hofer. 2005. “Aviation Security Screeners Visual Abilities and Visual Knowledge Measurement.” Aerospace and Electronic Systems Magazine, IEEE 20 (6): 29–35.
   Web of Science ®Google Scholar
• See, J. E. 2012. “Visual Inspection: a Review of the Literature.” Sandia Report (SAND2012-8590). October 2012. Sandia National Laboratories, New Mexico.
   Google Scholar
• Sheridan, T. B., and W. L. Verplank. 1978. Human and Computer Control of Undersea Teleoperators. Technical Report. Cambridge, MA: MIT Man-Machine Systems Laboratory.
   Google Scholar
• Sterchi, Y., and A. Schwaninger. 2015. “A First Simulation on opTimizing EDS for Cabin Baggage Screening Regarding Throughput.” Paper presented at the International Carnahan Conference on Security Technology (ICCST), September 21–24, Taipei, Taiwan, 55–60.
   Google Scholar
• van Dongen, K., and P.-P. van Maanen. 2013. “A Framework for Explaining Reliance on Decision Aids.” International Journal of Human-Computer Studies 71 (4): 410–424. doi:10.1016/j.ijhcs.2012.10.018.
   Web of Science ®Google Scholar
• Warm, J. S., R. Parasuraman, and G. Matthews. 2008. “Vigilance Requires Hard Mental Work and is Stressful.” Human Factors 50 (3): 433–441. doi:10.1518/001872008X312152.
   PubMed Web of Science ®Google Scholar
• Wales, A. W. J., C. Anderson, K. L. Jones, A. Schwaninger, and J. A. Horne. 2009. “Evaluating the two-component inspection model in a simplified luggage search task.” Behavior Research Methods 41 (3): 937–943. doi:10.3758/BRM.41.3.937.
   PubMed Web of Science ®Google Scholar
• Wells, K., and D. A. Bradley. 2012. “A Review of X-ray Explosives Detection Techniques for Checked Baggage.” Applied Radiation and Isotopes 70 (8): 1729–1746. doi:10.1016/j.apradiso.2012.01.011.
   PubMed Web of Science ®Google Scholar
• Wickens, C. D., and S. R. Dixon. 2007. “The Benefits of Imperfect Diagnostic Automation: A synThesis of the Literature.” Theoretical Issues in Ergonomics Science 8 (3): 201–212. doi:10.1080/14639220500370105.
   Google Scholar
• Wiegmann, D., J. S. McCarley, A. F. Kramer, and C. D. Wickens. 2006. “Age and Automation Interact to Influence Performance of a Simulated Luggage Screening Task.” Aviation, Space, and Environmental Medicine 77 (8): 825–831.
   PubMed Web of Science ®Google Scholar
• Wiegmann, D. A. 2002. “Agreeing with Automated Diagnostic Aids: A study of Users’ Concurrence Strategies.” Human Factors 44 (1): 44–50. doi:10.1518/0018720024494847.
   PubMed Web of Science ®Google Scholar
• Wiegmann, D. A., A. Rich, and H. Zhang. 2001. “Automated Diagnostic Aids: The Effects of Aid Reliability on Users’ Trust and Reliance.” Theoretical Issues in Ergonomics Science 2 (4): 352–367. doi:10.1080/14639220110110306.
   Google Scholar
• Wolfe, J. M., D. N. Brunelli, J. Rubinstein, and T. S. Horowitz. 2013. “Prevalence Effects in Newly Trained Airport Checkpoint Screeners: Trained Observers Miss Rare Targets, Too.” Journal of Vision 13 (3): 1–9. doi:10.1167/13.3.33.
   Web of Science ®Google Scholar
• Wolfe, J. M., T. S. Horowitz, M. J. van Wert, N. M. Kenner, S. S. Place, and N. Kibbi. 2007. “Low target prevalence is a stubborn source of errors in visual search tasks.” Journal of Experimental Psychology: General 136 (4): 623–638. doi:10.1037/0096-3445.136.4.623.
   PubMed Web of Science ®Google Scholar
• Yeh, M., and C. D. Wickens. 2001. “Display Signaling in Augmented Reality: Effects of Cue Reliability and Image Realism on Attention Allocation and Trust Calibration.” Human Factors 43 (3): 355–365. 10.1518/001872001775898269.
   PubMed Web of Science ®Google Scholar