Application of Eye Tracking for Measurement and Evaluation in Human Factors Studies in Control Room Modernization

Abstract

An important element of human factors engineering (HFE) pertains to measurement and evaluation (M&E). The role of HFE-M&E should be integrated throughout the entire control room modernization (CRM) process and be used for human–system performance evaluation and diagnostic purposes to resolve potential human engineering deficiencies and other human–machine interface design issues. NUREG-0711 describes how HFE in CRM should employ a hierarchical set of measures, particularly during integrated system validation, including plant performance, personnel task performance, situation awareness, cognitive workload, and anthropometric/physiological factors. Historically, subjective measures have been primarily used since they are easier to collect and do not require specialized equipment. However, there are pitfalls with relying solely on subjective measures in M&E such as negatively impacting reliability, sensitivity, and objectivity. As part of comprehensively capturing a diverse set of measures that strengthen findings and inferences made about the benefits from emerging technologies like advanced displays, this paper discusses the value of using eye tracking as an objective method that can be used in M&E. A brief description of eye tracking technology and relevant eye tracking measures is provided. Additionally, technical considerations and the unique challenges with using eye tracking in full-scale simulations are addressed. Finally, this paper shares preliminary findings regarding the use of a wearable eye tracking system in a full–scale simulator study. These findings should help guide future full–scale simulator studies using eye tracking as a methodology to evaluate human-system performance.

Keywords:

• Eye tracking
• human factors engineering
• control room modernization

Acknowledgments

INL is a multiprogram laboratory operated by Battelle Energy Alliance LLC, for the United States Department of Energy under contract DE-AC07-05ID14517. This work of authorship was prepared as an account of work sponsored by an agency of the United States Government. Neither the United States Government, nor any agency thereof, nor any of their employees makes any warranty, express or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately-owned rights. The United States Government retains, and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a nonexclusive, paid-up, irrevocable, world-wide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States government or any agency thereof. The INL issued document number for this paper is INL/JOU-16-404000.

Additional information

Funding

This work was supported by the United States Government; U.S. Department of Energy [DE-AC07-05ID14517].