The Effects of Visual Complexity and Decluttering Methods on Visual Search and Target Detection in Cockpit Displays

ABSTRACT

Efficient visual search and accurate target detection are crucial during flight operations. Despite the continuous effort to improve cockpit displays, visual complexity remains to be a problem that affects pilots’ search and detection performance. This has become more evident with the integration of high fidelity and information loaded cockpit displays of the fifth-generation fighter aircraft. One known but often overlooked solution to mitigate the problem with visual complexity is by decluttering. This study aims to provide an objective definition of visual complexity in cockpit displays and investigate its effects on visual search time and target detection accuracy. Moreover, it also aims to compare the visual search and target detection performance across different decluttering methods. Lastly, it intends to propose threat-based criteria for decluttering information in cockpit displays. The present study is divided into three sections, each addressing one of the three main objectives of this research. In study 1, visual search time and target detection accuracy were compared across three conditions that consist of displays with varying levels of visual complexity (low, medium and high). Visual complexity is operationally defined as the combination of different features (color, shape and orientation) and its variations (e.g., color: red, green, white). In study 2, differences in visual search time and target detection accuracy across four decluttering methods (dimming, dotting, small sizing and removal) and between groups (pilot and non-pilot) were analyzed. In study 3, through AHP analysis a threat scoring equation was proposed and tested. The results of the first study suggest that increased visual complexity leads to an increase in visual search time and more target detection errors. On the other hand, findings from the latter study revealed that there is a significant difference in the visual search time and target detection accuracy between different decluttering methods. Moreover, group differences were found when the threat scoring equation was applied to the targets. The results of the present study could provide inferences on how to alleviate the adverse effects of visual complexity through the utilization of effective decluttering methods, which in turn could further improve pilots’ overall performance.

Additional information

Notes on contributors

May Jorella Lazaro

May Jorella Lazaro received her MS degree in Engineering and is currently a PhD candidate in Cognitive Science at Seoul National University. She received her double BS/AB degree in Psychology at St. Scholastica’s College. Her research interest are focused on the applications of cognitive engineering and multimodal interaction.

Yohan Kang

Yohan Kang is an R.O.K. Air Force F-15K fighter pilot. He graduated from the Department of Mechanical Engineering at R.O.K. Air Force Academy and he obtained his master’s degree in Industrial Engineering from Seoul National University. His research interests are aviation accident prevention and VR-based flight training system.

Myung Hwan Yun

Myung Hwan Yun is Professor in the Department of Industrial Engineering at Seoul National University. He received his PhD degree in Industrial and Manufacturing Engineering at Penn State University, USA in 1994. His research interests include human factors, user-centered design, affective engineering, and intelligent human–machine interface.

Sungho Kim

Sungho Kim is a PhD candidate in the Department of Industrial Engineering at Seoul National University. He received his BS degree in Electronic Engineering at R.O.K. Air Force Academy and MS degree in Industrial and Management Engineering at POSTECH. His research interests include pilot-vehicle interface analysis and cockpit layout design.