Variance as a Measure of Performance in an Aviation Context

Abstract

A combined measure of performance (i.e., constant error plus variable error) is a common approach to determining aircraft pilot performance. However, a variable error measure has worked well as a performance measure in highway driving. Twenty novice participants were recruited to participate in a study that tested flying performance in a simulator criterion trial following simulated flight training. The data were analyzed first using a common root mean square error measure (combined error). The same data were subsequently analyzed using a variable error measure and the results were compared and contrasted. Results indicated that the variable error approach was sensitive, precise, and efficient when measuring pilot performance. Explanations for why this is a particularly suitable approach in an aviation context are provided.

ACKNOWLEDGMENTS

The views expressed in this article are those of the authors and do not reflect the official policy or position of the United States Air Force, Department of Defense, or the U.S. Government.

This research was performed at the Modeling, Virtual Environments, and Simulation (MOVES) Institute, Naval Postgraduate School, in partial fulfillment of the doctoral degree requirements of the first Christopher K. McClernon. Major McClernon would like to extend a special thank you to his dissertation committee members for their continued support: Drs. Michael McCauley, William Becker, Anthony Ciavarelli, Rudolph Darken, Nita Miller, and Paul O'Connor. Major McClernon is currently assigned to the Air Force Research Laboratory, Wright-Patterson AFB, Ohio.