A note on the validity and reliability of ergonomics methods

The view that, by analogy, ergonomics methods should be subject to the same requirements of validity and reliability as are demanded of psychometric tests is shown to be an oversimplification. Two broad classes of method are distinguished. Analytic methods aim to produce a better understanding of the processes affecting complex human-machine systems, whilst evaluative methods are limited to the measurement of specific variables. The analogy with psychometrics applies to the latter type but is less appropriate to the former. Analytic methods depend heavily on the application of currently accepted theories of performance. Empirical data may be variable, but the expertise of the analyst may be more to blame than the method as such.