Effects of measurement errors on psychometric measurements in ergonomics studies: Implications for correlations, ANOVA, linear regression, factor analysis, and linear discriminant analysis

References

• American Educational Research Association, American Psychological Association, and the National Council on Measurement in Education . 1999 . Standards for educational and Psychological testing , Washington, D.C. : American Educational Research Association .
   Google Scholar
• Armor , D. 1974 . “ Theta reliability and factor scaling ” . In Sociological methodology , Edited by: Costner , H. 17 – 50 . San Francisco, CA : Jossey-Bass .
   Google Scholar
• Bakan , D. 1966 . The test of significance in psychological research . Psychological Bulletin , 66 : 423 – 437 .
   PubMed Web of Science ®Google Scholar
• Bohrnstedt , G. W. 1983 . “ Measurement ” . In Handbook of survey research , Edited by: Rossi , P. H. , Wright , J. D. and Anderson , A. B. 69 – 121 . New York : Academic Press .
   Google Scholar
• Brown , W. 1910 . Some experimental results in the correlation of mental abilities . British Journal of Psychology , 3 : 296 – 322 .
   Google Scholar
• Carayon , P. and Salvendy , G. 1997 . “ Data collection and evaluation of outcome measures ” . In Handbook of human factors and ergonomics , 2nd edition , Edited by: Salvendy , G. 1451 – 1471 . New York : John Wiley & Sons Inc. .
   Google Scholar
• Carmines , E. G. and Zeller , R. A. 1979 . Reliability and validity assessment , Thousand Oaks, CA : Sage Publications .
   Google Scholar
• Carroll , R. J. and Stefanski , L. A. 1995 . Measurement error in nonlinear models , London : Chapman & Hall .
   Google Scholar
• Chang , C.-H. , Wang , J.-D. and Hwang , Y.-H. 2004 . Development of a monitoring system for keyboard users' performance . Ergonomics , 47 ( 14 ) : 1571 – 1581 .
   PubMed Web of Science ®Google Scholar
• Cliff , N. 1984 . An improved internal consistency reliability estimate . Journal of Educational Statistics , 9 : 151 – 161 .
   Google Scholar
• Cohen , J. 1994 . The earth is round (p < .05) . American Psychologist , 49 : 997 – 1003 .
   Web of Science ®Google Scholar
• Crocker , L. and Algina , J. 1986 . Introduction to classical and modern test theory , New York : CBS College Publishing .
   Google Scholar
• Cronbach , L. J. 1951 . Coefficient alpha and the internal structure of tests . Psychometrika , 16 : 297 – 334 .
   Web of Science ®Google Scholar
• Cronbach , L. J. and Furby , L. 1970 . How should we measure ‘change’—Or should we? . Psychological Bulletin , 74 : 68 – 80 .
   Web of Science ®Google Scholar
• Cummings , M. L. 2004 . The need for command and control instant message adaptive interfaces: lessons learned from Tactical Tomahawk human-in-the-loop simulations . Cyberpsychology & Behavior , 7 ( 6 ) : 653 – 661 .
   PubMedGoogle Scholar
• Demerouti , E. 2004 . The impact of shiftwork on work-home conflict, job attitudes and health . Ergonomics , 47 ( 9 ) : 987 – 1002 .
   PubMed Web of Science ®Google Scholar
• Dixon , P. and O'Reilly , T. 1999 . Scientific versus statistical inference . Canadian Journal of Experimental Psychology , 53 : 133 – 149 .
   Web of Science ®Google Scholar
• Dwyer , J. H. 1983 . Statistical models for the social and behavioral sciences , New York : Oxford University Press Inc .
   Google Scholar
• Edwards , P. J. 2005 . Understanding users with diabetic retinopathy: factors that affect performance in a menu selection task . Behaviour and Information Technology , 24 ( 3 ) : 175 – 186 .
   Web of Science ®Google Scholar
• Edwards , W. 1965 . Tactical note on the relation between scientific and statistical hypotheses . Psychological Bulletin , 63 : 400 – 402 .
   PubMed Web of Science ®Google Scholar
• Embretson , S. E. 1996 . The new rules of measurement . Psychological Assessment , 8 ( 4 ) : 341 – 349 .
   Web of Science ®Google Scholar
• Everitt , B. S. and Dunn , G. 1991 . Applied multivariate data analysis , London : Halsted Press .
   Google Scholar
• Eysenck , H. J. and Fulker , D. W. 1979 . The structure and measurement of intelligence , New York : Springer-Verlag .
   Google Scholar
• Fabrigar , L. R. 1999 . Evaluating the use of exploratory factor analysis in psychological research . Psychological Methods , 4 : 272 – 299 .
   Web of Science ®Google Scholar
• Fitts , P. M. 1954 . The information capacity of the human motor system in controlling the amplitude of movement . Journal of Experimental Psychology , 47 : 381 – 391 .
   PubMedGoogle Scholar
• Fleiss , J. L. 1971 . Measuring nominal scale agreement among many raters . Psychological Bulletin , 76 ( 5 ) : 378 – 382 .
   Google Scholar
• Fuller , W. A. 1987 . Measurement error models , New York : John Wiley & Sons Inc. .
   Google Scholar
• Ghiselli , E. E. , Campbell , J. P. and Zedeck , S. 1981 . Measurement theory for the behavioral sciences , New York : Freeman Press .
   Google Scholar
• Giles , D. 2002 . Advanced research methods in psychology , New York : Routledge .
   Google Scholar
• Gill , J. 2002 . Bayesian methods: A social and behavioral sciences approach , New York : Chapman & Hall .
   Google Scholar
• Gleser , L. J. , Carroll , R. J. and Gallo , P. P. 1987 . The limiting distribution of least squares in an errors-in-variables linear regression model . Annals of Statistics , 15 : 220 – 233 .
   Web of Science ®Google Scholar
• Harlow L. L. Mulaik S. A. Steiger J. H. What if there were no significance tests? Lawrence Erlbaum Mahwah, NJ 1997
   Google Scholar
• Heise , D. R. and Bohrnstedt , G. W. 1970 . “ Validity, invalidity, and reliability ” . In Sociological methodology , Edited by: Borgatta , E. and Bohrnst , G. W. 104 – 129 . San Francisco, CA : Jossey-Bass .
   Google Scholar
• Hinkle , D. E. , Wiersma , W. and Jurs , S. G. 1998 . Applied statistics for the behavioral sciences , 5th edition , Boston, MA : Houghton Mifflin .
   Google Scholar
• Hosmer , D. and Lemeshow , S. 1989 . Applied logistic regression , New York : John Wiley and Sons, Inc. .
   Google Scholar
• Howard , E. P. 1985 . Applying the Rasch Model to test administration . Journal of Nursing Education , 24 : 340 – 343 .
   PubMedGoogle Scholar
• Huberty , C. 1987 . On statistical testing . Educational Researcher , 16 : 4 – 9 .
   Google Scholar
• Jeng , M. 2006 . Error in statistical tests of error in statistical tests . BMC Medical Research Methodology , 6 ( 45 ) [online]. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1586023 [Accessed 10 December 2007]
   PubMedGoogle Scholar
• Johnson , R. A. and Wichern , D. W. 2002 . Applied multivariate statistical analysis , Upper Saddle Rever, NJ : Prentice Hall .
   Google Scholar
• Keppel , G. and Wickens , T. 2004 . Design and analysis: A researcher's handbook , 4th edition , Upper Saddle Rever, NJ : Pearson Prentice Hall .
   Google Scholar
• Kim , B. and Bishu , R. R. 1996 . On assessing operator response time in human reliability analysis (HRA) using a possibilistic fuzzy regression model . Reliability Engineering & System Safety , 52 ( 1 ) : 27 – 34 .
   Web of Science ®Google Scholar
• Kirk , R. 1996 . Practical significance: a concept whose time has come . Educational and Psychological Measurement , 56 : 746 – 759 .
   Web of Science ®Google Scholar
• Klecka , W. 1980 . Discriminant analysis , Thousand Oaks, CA : Sage Publications .
   Google Scholar
• Knapp , T. R. 1991 . Coefficient alpha: conceptualizations and anomalies . Research in Nursing & Health , 14 : 457 – 460 .
   PubMed Web of Science ®Google Scholar
• Knapp , T. R. 2002 . Reliability of measuring instruments , 2nd edition , Vancouver, , Canada : Edgeworth Laboratory for Quantitative Educational and Behavioral Science Series, University of British Columbia .
   Google Scholar
• Kossinets , G. 2006 . Effects of missing data in social networks . Social Networks , 28 ( 3 ) : 247 – 268 .
   Web of Science ®Google Scholar
• Krus , D. J. and Helmstadter , G. C. 1993 . The problem of negative reliabilities . Educational and Psychological Measurement , 53 : 643 – 650 .
   Web of Science ®Google Scholar
• Kuder , G. F. and Richardson , M. W. 1937 . The theory of the estimation of test reliability . Psychometrika , 2 : 151 – 160 .
   Web of Science ®Google Scholar
• LeMay , M. and Hird , E. 1985 . Operator work load: when is enough? . Communications of ACM , 29 ( 7 ) : 638 – 642 .
   Web of Science ®Google Scholar
• McDonald , R. P. 1999 . Test theory: A unified treatment , Mahwah, NJ : Erlbaum .
   Google Scholar
• MacKenzie , I. S. and Zhang , S. X. 2001 . An empirical investigation of the novice experience with soft keyboards . Behaviour & Information Technology , 20 : 411 – 418 .
   Web of Science ®Google Scholar
• Magnusson , D. 1967 . Test theory , Reading, MA : Addison-Wesley Publishing Company .
   Google Scholar
• Miller , G. L. , Yearout , R. D. and Neimkin , R. 1998 . “ Assessing carpal tunnel syndrome Risk via discriminant analysis ” . In Advances in occupational ergonomics and safety , Edited by: Kumar , S. 794 – 797 . Amsterdam : IOS Press .
   Google Scholar
• Montgomery , D. C. 2005 . Design and analysis of experiments , 6th edition , Hoboken, NJ : John Wiley & Sons Inc .
   Google Scholar
• Oviatt , S. 1995 . Predicting spoken disfluencies during human–computer interaction . Computer Speech and Language , 9 ( 1 ) : 19 – 35 .
   Web of Science ®Google Scholar
• Raju , N. S. 1977 . A generalization of coefficient alpha . Psychometrika , 42 : 549 – 565 .
   Web of Science ®Google Scholar
• Reichardt , C. S. and Gollob , H. F. 1997 . “ When confidence intervals should be used instead of statistical tests, and vice versa ” . In What if there were no significance tests? , Edited by: Harlow , L. L. , Mulaik , S. A. and Steiger , J. H. 259 – 284 . Mahwah, NJ : Lawrence Erlbaum .
   Google Scholar
• Salvendy , G. and Seymour , W. D. 1973 . Prediction and development of industrial work performance , New York : John Wiley & Sons Inc. .
   Google Scholar
• Schmidt , F. L. and Hunter , J. E. 1996 . Measurement error in psychological research: lessons from 26 research scenarios . Psychological Methods , 1 ( 2 ) : 199 – 223 .
   Web of Science ®Google Scholar
• Schneeweiss , H. and Augustin , T. 2006 . Some recent advances in measurement error models and methods . Allgemenies Statistisches Archiv , 90 ( 1 ) : 183 – 197 .
   Google Scholar
• Serlin , R. C. and Lapsley , D. K. 1985 . Rationality in psychological research . American Psychologist , 40 : 73 – 83 .
   Web of Science ®Google Scholar
• Shrout , P. E. and Fleiss , J. L. 1979 . Intraclass correlations: use in assessing interrater reliability . Psychological Bulletin , 86 : 420 – 428 .
   PubMed Web of Science ®Google Scholar
• Thompson , B. 1994 . The concept of statistical significance testing . Practical Assessment, Research & Evaluation , 4 ( 5 ) [online]. Available from: http://PAREonline.net/getvn.asp?v=4&n=5 [Accessed 10 December 2007]
   Google Scholar
• Toms , E. G. and Taves , A. R. 2004 . Measuring user perceptions of Web site reputation . Information Processing & Management , 40 ( 2 ) : 291 – 317 .
   Web of Science ®Google Scholar
• Torkzadeh , R. , Pflughoeft , K. and Hall , L. 1999 . Computer self-efficacy, training effectiveness and user attitudes: an empirical study . Behaviour and Information Technology , 18 ( 4 ) : 299 – 309 .
   Web of Science ®Google Scholar
• Viswanathan , M. 2005 . Measurement error and research design , Thousand Oaks, CA : Sage Publication Inc. .
   Google Scholar
• Weisberg , S. 2005 . Applied linear regression , 3rd edition , Hoboken, NJ : John Wiley & Sons .
   Google Scholar