Obtaining Content Weights for Test Specifications From Job Analysis Task Surveys: An Application of the Many-Facets Rasch Model

REFERENCES

• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education . 1999 . Standards for educational and psychological testing , Washington , DC : American Psychological Association .
   Google Scholar
• Andrich , D. 1988 . A general form of Rasch's extended logistic model for partial credit scoring . Applied Measurement in Education , 4 : 363 – 378 .
   Google Scholar
• Bond , T. G. and Fox , C. M. 2001 . Applying the Rasch model: Fundamental measurement in the human sciences , Mahwah , NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Cascio , W. F. and Ramos , R. A. 1986 . Development and application of a new method for assessing job performance in behavioral/economic terms . Journal of Applied Psychology , 71 : 20 – 28 .
   Web of Science ®Google Scholar
• Engelhard , G. Jr. 1994 . Examining rater errors in the assessment of written composition with a many-faceted Rasch model . Journal of Educational Measurement , 31 ( 2 ) : 93 – 112 .
   Web of Science ®Google Scholar
• Engelhard , G. Jr. 1996 . Evaluating rater accuracy in performance assessments . Journal of Educational Measurement , 33 ( 1 ) : 56 – 70 .
   Web of Science ®Google Scholar
• Harwell , M. R. and Gatti , G. G. 2001 . Rescaling ordinal data to interval data in educational research . Review of Educational Research , 71 ( 1 ) : 105 – 131 .
   Web of Science ®Google Scholar
• Joseph , M. and Newman , L. 1998 . Weighting job analysis data: Comparison of Kane's multiplicative model and Rasch model , Washington , DC : Paper presented at the 10th Annual Convention of American Psychological Society .
   Google Scholar
• Joseph , M. and Taranath , S. 1999 . Obtaining task measures from job analysis data , Montreal , , Canada : Paper presented at the annual meeting of the National Council on Measurement in Education .
   Google Scholar
• Kane , M. 1982 . The validity of licensure examinations . American Psychologist , 6 : 161 – 171 .
   Google Scholar
• Kane , M. 1986 . “ The future of testing for licensure and certification examinations ” . In The future of testing , Edited by: Plake , B. and Will , J. 145 – 181 . Hillsdale , NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Kane , M. , Kingsbury , C. , Colton , D. and Estes , C. 1989 . Combining data on criticality and frequency in developing test plans for licensure and certification examinations . Journal of Educational Measurement , 26 ( 1 ) : 17 – 27 .
   Web of Science ®Google Scholar
• Linacre , J. M. 1989 . Many-faceted Rasch measurement , Chicago , IL : MESA Press .
   Google Scholar
• Linacre , J. M. 1997 . User's guide to FACETS Rasch measurement computer program , Chicago , IL : MESA Press .
   Google Scholar
• Linacre , J. M. 2006a . FACETS Rasch measurement computer program , Chicago , IL : Winsteps.com .
   Google Scholar
• Linacre , J. M. 2006b . WINSTEPS Rasch measurement computer program , Chicago , IL : Winsteps.com .
   Google Scholar
• Linacre , J. M. and Wright , B. D. 1998 . Bigsteps/Winsteps , Chicago , IL : MESA Press . [Computer software]
   Google Scholar
• Lunz , M. and Schumacker , R. E. 1997 . Scoring and analysis of performance examinations: A comparison of methods and interpretations . Journal of Outcome Measurement , 1 ( 3 ) : 219 – 238 .
   Google Scholar
• Lunz , M. , Stahl , J. and James , K. 1989 . Content validity revisited: Transforming job analysis data into test specifications . Evaluation and the Health Professions , 12 ( 2 ) : 192 – 206 .
   Web of Science ®Google Scholar
• Mehren , W. A. 1997 . Validating licensing and certification test score interpretations and decisions: A response . Applied Measurement in Education , 10 ( 1 ) : 97 – 104 .
   Web of Science ®Google Scholar
• Nelson , D. S. 1993 . A linear model for combining job analysis data on criticality and frequency in developing test specifications for licensure and certification examinations , Los Angeles, CA: University of Southern California . (Unpublished doctoral dissertation)
   Google Scholar
• Nelson , D. S. 1994 . Job analysis for licensure and certification exams: Science or politics? . Educational Measurement: Issues and Practices , 13 ( 3 ) : 29 – 35 .
   Google Scholar
• Newman , L. and Joseph , M. 1998 . Job analysis technical report: ASI real estate licensing program , Bala Cynwyd , PA : Assessment Systems .
   Google Scholar
• Newman , L. , Slaughter , R. and Taranath , S. 1999 . The selection and use of rating scales in task surveys: A review of current job analysis practice , Montreal , , Canada : Paper presented at the annual meeting of the National Council on Measurement in Education .
   Google Scholar
• Raymond , M. 2001 . Job analysis and the specification of content for licensure and certification examinations . Applied Measurement in Education , 14 ( 4 ) : 369 – 415 .
   Web of Science ®Google Scholar
• Raymond , M. 2002 . A practical guide to practice analysis for credentialing examinations . Educational Measurement: Issues and Practice , 21 ( 3 ) : 25 – 37 .
   Google Scholar
• Smith , E. V. Jr. and Smith , R. M. 2004 . Introduction to Rasch measurement: Theory, models, and applications. , Maple Grove , MN : JAM Press .
   Google Scholar
• Smith , E. V. Jr. and Smith , R. M. 2007 . Rasch measurement: Advanced and specialized applications. , Maple Grove , MN : JAM Press .
   Google Scholar
• Spray , J. and Huang , C. 2000 . Obtaining test blueprint weights from job analysis surveys . Journal of Educational Measurement , 37 ( 3 ) : 187 – 201 .
   Web of Science ®Google Scholar
• Thomas , L. and Kalohn , J. 1996 . Weighting tasks from job analysis data to derive test specifications for licensure examinations: Some methodological and statistical considerations , New York , NY : Paper presented at the annual meeting of the American Educational Research Association .
   Google Scholar
• Wang , N. 2002 . Obtaining task importance weights from job analysis survey data: An application of the multi-faceted Rasch model , New Orleans , LA : Paper presented at the 11th biennial meeting of the International Objective Measurement .
   Google Scholar
• Wang , N. 2003 . Examining reliability and validity of job analysis survey data . Journal of Applied Measurement , 4 ( 4 ) : 358 – 369 .
   PubMedGoogle Scholar
• Wang , N. 2010 . “ Applications of Rasch measurement to job analysis data and the translation into content weights ” . In Applications of Rasch measurement in criterion-referenced testing: Practice analysis to score reporting , Edited by: Smith , E. and Stone , G. 1 – 23 . Chicago , IL : JAM Press .
   Google Scholar
• Wang , N. , Schnipke , D. and Witt , E. 2005 . Use of knowledge, skill, and ability statements in developing licensure and certification examinations . Educational Measurement: Issues and Practice , 24 ( 1 ) : 15 – 22 .
   Google Scholar
• Wang , N. and Stahl , J. 2004 . Rescaling job analysis task weights for the development of test specifications , San Diego , CA : Paper presented at the 2004 annual meeting of the National Council on Measurement in Education .
   Google Scholar
• Wang , N. and Stahl , J. 2005 . Rescaling job analysis survey task weights for test development , Montreal , , Canada : Paper presented at the 2005 annual meeting of the American Educational Research Association .
   Google Scholar
• Wang , N. , Wiser , R. and Joseph , M. 1999 . Examining validity and reliability of job analysis survey data , Montreal , , Canada : Paper presented at the annual meeting of the National Council on Measurement in Education .
   Google Scholar
• Wright , B. D. , Congdon , R. and Schulz , E. M. 1988 . “ MSCALE ” . In A Rasch program for ordered categories, person measurement, item calibration and person and fit analysis , Chicago , IL : MESA Press .
   Google Scholar