Designing criterion measures for physically demanding jobs

References

• Ainsworth, B. E., Haskell, W. L., Whitt, M. C., Irwin, M. L., Swartz, A. M., Strath, S. J., O’Brien, W. L., Bassett, D. R., Schmitz, K. H., Emplaincourt, P. O., Jacobs, D. R., & Leon, A. S. (2000). Compendium of physical activities: An update of activity codes and MET intensities. Medicine & Science in Sports & Exercise, 32(9), S498–S516. https://doi.org/10.1097/00005768-200009001-00009
   PubMed Web of Science ®Google Scholar
• Air Force. (2013). Air force enlisted classification directory.
   Google Scholar
• Baker, T. A., & Gebhardt, D. L. (2012). Chapter 13: The assessment of physical capabilities in the workplace. In N. Schmitt (Ed.), Handbook of assessment and selection (pp. 274–296). Oxford University Press, Inc.
   Google Scholar
• Bilzon, J. L., Scarpello, E. G., Smith, C. V., Ravenhill, N. A., & Rayson, M. P. (2001). Characterization of the metabolic demands of simulated shipboard Royal Navy fire-fighting tasks. Ergonomics, 44(8), 766–780. https://doi.org/10.1080/00140130118253
   PubMed Web of Science ®Google Scholar
• Borman, W. C., & Smith, T. N. (2012). Chapter 23: The use of objective measures as criteria in I/O psychology. In N. Schmitt (Ed.), Handbook of assessment and selection (pp. 532–542). Oxford University Press, Inc.
   Google Scholar
• Bureau of Labor Statistics, U.S. Department of Labor. (2018). The economics daily: Physical strength required for jobs in different occupations in 2018. [online 2019]. http://www.bls.gov/opub/ted/2017/physical-strength-required-for-jobs-in-different-occupations-in-2016.htm
   Google Scholar
• Bureau of Labor Statistics, U.S. Department of Labor. (2020). Occupational requirements surgery, [online 2021]. https://data.bls.gov/pdq/SurveyOutputServlet
   Google Scholar
• Canadian Human Rights Act, RSC. (1985). c H-6.
   Google Scholar
• Cascio, W. F. (1998). Applied psychology in human resource management. Prentice Hall.
   Google Scholar
• Chan, D., & Schmitt, N. (1997). Video-based versus paper and pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions. Journal of Applied Psychology, 82(1), 143–159. https://doi.org/10.1037/0021-9010.82.1.143
   PubMed Web of Science ®Google Scholar
• Civil Rights Act of 1964 (Title VII), 42 U.S.C. §2000e-2, et seq. (1964).
   Google Scholar
• Cizek, G. J. (2012). Setting performance standards: Foundation, methods, and innovations. Routledge.
   Google Scholar
• Clark, C. C., & Rooney, N. J. (2021). Does benchmarking of rating scales improve ratings of search performance given by specialist search dog handlers? Frontiers in Veterinary Science, 8(2), 545398–545413. https://doi.org/10.3389/fvets.2021.545398
   PubMedGoogle Scholar
• Crocker, L. A., & Algina, J. (1986). Introduction to classical and modern test theory. Harcourt.
   Google Scholar
• Department of the Army. (2016). Prevention of heat and cold casualties. United States Army Training and Doctrine Command. (TRADOC Regulation 350-29).
   Google Scholar
• Department of the Navy. (2016). Naval Academy preparatory school instruction 6110.1A. Naval Academy Preparatory School.
   Google Scholar
• Equal Employment Opportunity Commission, Civil Service Commission, Department of Labor, and Department of Justice. (1978). Uniform guidelines on employee selection procedures. Bureau of National Affairs, Inc.
   Google Scholar
• Equality Act (UK). (2010). The national archives. [Retrieved March, 2013]. https://www.equalityhumanrights.com/en/equality-act-2010/what-equality-act
   Google Scholar
• Fleishman, E. A., Quaintance, M. K., & Broedling, L. A. (1984). Taxonomies of human performance: The description of human tasks. Academic Press.
   Google Scholar
• Forehand, M. (2010). Chapter 3: Bloom’s taxonomy: Original and revised. In M. Orey (Ed.), Emerging perspectives on learning, teaching, and technology (pp. 41–47). Jacobs Foundation.
   Google Scholar
• Foulis, S. A., Redmond, J. E., Frykman, P. N., Warr, B. J., Zambraski, E. J., & Sharp, M. A. (2017). U.S. Army physical demands study: Reliability of simulations of physically demanding tasks performed by combat arms soldiers. Journal of Strength and Conditioning Research, 31(12), 3245–3252. https://doi.org/10.1519/JSC.0000000000001894
   PubMed Web of Science ®Google Scholar
• Foulis, S. A., Redmond, J. E., Warr, B. J., Zambraski, E. J., Frykman, P. N., Gebhardt, D. L., & Sharp, M. A. (2015). Development of occupational physical assessment test (OPAT) for Combat Arms soldiers (Report No. T16-2). U.S. Army Research Institute of Environmental Medicine.
   Google Scholar
• Foulis, S. A., Sharp, M. A., Redmond, J. E., Frykman, P. N., Warr, B. J., Gebhardt, D. L., … Zambraski, E. J. (2017). U.S. Army physical demands study: Development of occupational physical assessment test for combat arms soldiers. Journal of Science and Medicine in Sports, 63(4), 571–579.
   Google Scholar
• Frykman, P. N., Foulis, S. A., Canino, M. C., Hydren, J. R., Redmond, J. E., & Sharp, M. A. (2019). Development of criterion measure task simulations for physically demanding tasks (T19-05). U.S. Army Research Institute of Environmental Medicine.
   Google Scholar
• Gebhardt, D. L., & Baker, T. A. (1999). Development and validation of a physical performance test for the selection of firefighters in State of New Jersey. Human Performance Systems, Inc.
   Google Scholar
• Gebhardt, D. L., & Baker, T. A. (2015). Development of models to predict United States Air Force specialty physical demand (2015 No. 056). Human Resources Research Organization.
   Google Scholar
• Gebhardt, D. L., & Baker, T. A. (2016). Development and validation of physical assessments for Huntington-Ingalls Shipyard jobs, Volume 2: Test development and validation. Human Resources Research Organization.
   Google Scholar
• Gebhardt, D. L., & Baker, T. A. (2017). Chapter 12: Physical performance tests. In J. Farr & N. Tippins (Eds.), Handbook on employee selection (2nd ed., pp. 277–297). Routledge.
   Google Scholar
• Gebhardt, D. L., Baker, T. A., & Linnenkohl, K. A. (2015). Development and validation of physical performance tests for selection into United States Air Force specialty. (2015 No. 051). Human Resources Research Organization.
   Google Scholar
• Gebhardt, D. L., Baker, T. A., & Thune, A. (2006). Development and validation of physical performance, cognitive, and personality assessments for selectors and delivery drivers. Human Performance Systems, Inc.
   Google Scholar
• Gebhardt, D. L., Baker, T. A., Volpe, E. K., & Billerbeck, K. T. (2009). Development and validation of physical performance tests for selection of orderfillers. Human Performance Systems, Inc.
   Google Scholar
• Gebhardt, D. L., Baker, T. A., Volpe, E. K., & St Ville, K. A. (2012). Development and validation of physical performance assessments for Southern California Edison linemen. Human Performance Systems, Inc.
   Google Scholar
• Gebhardt, D. L., Baker, T. A., Volpe, E. M., & St Ville, K. A. (2015). Development and validation of physical assessments for Huntington-Ingalls Shipyard jobs, Volume 1: Job analysis. Human Performance Systems, Inc.
   Google Scholar
• Gebhardt, D. L., & Crump, C. E. (1984). Validation of physical performance selection tests for paramedics. Advanced Research Resources Organization.
   Google Scholar
• Gledhill, N., & Jamnik, V. K. (1992). Characterization of the physical demands of firefighting. Canadian Journal of Sport Science, 17(3), 207–213.
   PubMedGoogle Scholar
• Hauret, K., Drain, J., Fieldhouse, A., Reilly, T., & Jackson, S. (2019). Chapter 6: The role of physical employment standards in musculoskeletal injury prevention. In T. Reilly Ed., Combat integration: Implications for physical employment standards (STRO-TR-HFM-269). ( pp. 6-1–6-23). North American Treaty Organization(NATO) – Science and Technology Organization. Chair.
   Google Scholar
• Hauret, K., Steelman, R., Pierce, J., Alemany, J., Sharp, M., Foulis, S., Redman, J., & Jones, B. (2018). Association of performance on the Occupational Physical Assessment Test (OPAT), injuries, and attrition during Initial Entry Training – OPAT Phase I (PHR No. S.0047229-18b). Army Public Health Center.
   Google Scholar
• Hughes, J., Foulis, S., Taylor, K., Guerrier, K., Walker, L., Hand, A., Popp, K. L., Gaffney-Stomberg, E., Heaton, K. J., Sharp, M. A., Grier, T. L., Hauret, K. G., Jones, B. H., Bouxsein, M. L., McClung, J. P., Matheny, R. W., & Proctor, S. (2019). A prospective field study of U.S. Army trainees to identify the physiological bases and key factors influencing musculoskeletal injuries: A study protocol. BMC Musculoskeletal Disorder, 20(1), 282–289. https://doi.org/10.1186/s12891-019-2634-9
   PubMedGoogle Scholar
• International Association of Fire Fighters (IAFF). (2007). Candidate physical ability test.
   Google Scholar
• Jones, B., Cowan, D., Tomlison, J., Robinson, J., Polly, D., & Frykman, P. (1993). Epidemiology of injuries associated with physical training among young men in the Army. Medicine and Science in Sports and Exercise, 25(2), 197–203. https://doi.org/10.1249/00005768-199302000-00006
   PubMed Web of Science ®Google Scholar
• Kehoe, J. F., & Sackett, P. R. (2017). Chapter 3: Validity considerations in the design and implementation of selection systems. In J. Farr & N. Tippins (Eds.), Handbook on employee selection (2nd ed., pp. 56–92). Routledge.
   Google Scholar
• Knapik, J. J., Canham-Chervak, M., Hauret, K., Hoedebecke, E., Laurin, M. J., & Cuthie, J. (2001). Discharges during U.S. Army basic training: Injury rates and risk factors. Military Medicine, 166(7), 641–647. https://doi.org/10.1093/milmed/166.7.641
   PubMed Web of Science ®Google Scholar
• Lad, U., Oomen, N., Callaghan, J., & Fischer, S. (2018). Comparing the biomechanical and psychophysical demands imposed on paramedics when using manual and powered stretcher. Applied Ergonomics, 70, 167–174. https://doi.org/10.1016/j.apergo.2018.03.001
   PubMed Web of Science ®Google Scholar
• Lee-Bates, B., Billing, D. C., Caputi, P., Carstairs, G. L., Linnane, P., & Middleton, K. (2017). The application of subjective job task analysis techniques in physically demanding occupations: Evidence for the presence of self-serving bias. Ergonomics, 60(9), 1240–1249. https://doi.org/10.1080/00140139.2016.1262063
   PubMed Web of Science ®Google Scholar
• Lievens, F., & De Soete, B. (2012). Chapter 17: Simulations. In N. Schmitt (Ed.), Handbook of assessment and selection (pp. 383–410). Oxford University Press, Inc.
   Google Scholar
• Liljegren, J. (2008). Wet Bulb Globe Temperature (WGBT), Version 1.2. Argonne National Laboratory, University of Chicago Argonne, LLC.
   Google Scholar
• McArdle, W. D., Katch, F. I., & Katch, V. L. (2014). Exercise physiology: Energy, nutrition, and human performance physiology (8th ed.). Lippincott Williams & Wilkins.
   Google Scholar
• McDaniel, J. W., Skandis, R. J., & Madole, S. W. (1983). Weight lift capabilities of Air Force basic trainees. (Report No. AFAMRL-TR-83-0001). Air Force Aerospace Medical Research Laboratory.
   Google Scholar
• McGurk, M. S. (personal communication, 2018, May, 1).
   Google Scholar
• Murphy, K. R. (2008). Explaining-the-weak-relationship-between-job-performance-and-ratings-of-job-performance. Industrial and Organizational Psychology, 1(2), 148–160. https://doi.org/10.1111/j.1754-9434.2008.00030.x
   Web of Science ®Google Scholar
• Murphy, K. R., & Balzer, W. K. (1989). Rater errors and rating accuracy. Journal of Applied Psychology, 74(4), 619–624. https://doi.org/10.1037/0021-9010.74.4.619
   Web of Science ®Google Scholar
• Naqvi, S. A., King, A., & Rook, C. (2001). Engineering standards development and ergonomics – A literature perspective with special focus on warehousing. Proceedings of SELF-ACE 2001 Conference – Ergonomics for Changing Work, Volume 4. University Park, PA: The Pennsylvania State University.
   Google Scholar
• National Center for O*NET Development. (2022). O*NET online. Retrieved January 19, 2022, from https://www.onetonline.org/
   Google Scholar
• Nye, N. S., Pawlak, M. T., Webber, B. J., Tchandja, J. N., & Milner, M. R. (2016). Description and rate of musculoskeletal injuries in Air Force basic military trainees - 2012-2014. Journal of Athletic Training, 51(11), 858–865. https://doi.org/10.4085/1062-6050-51.10.10
   PubMed Web of Science ®Google Scholar
• Park, S., & Hubert, M. (2017). Motivating raters through work design: Applying the job characteristics model to the performance appraisal context. Cogent Psychology, 4(1), 1287320. https://doi.org/10.1080/23311908.2017.1287320
   Web of Science ®Google Scholar
• P.L. 113-291; 128 Stat. 1919; September 19, 2014. (2015). [Carl Levin and Howard P. “Buck” McKeon National Defense Authorization Act for Fiscal Year 2015; Section 524]. 113th Congress
   Google Scholar
• Putka, D. J. (2017). Chapter 1: Reliability. In J. Farr & N. Tippins (Eds.), Handbook on employee selection (2nd ed., pp. 3–33). Routledge.
   Google Scholar
• Reilly, T., Blacker, S., Sharp, M., Gebhardt, D., Brown, P., Drain, J., & Kilding, H. (2019). Chapter 3: NATO Guide for PES development. In T. Reilly (Ed.), Combat integration: Implications for physical employment standards (STRO-TR-HFM-269) ( pp. 3-1–3-48). North American Treaty Organization(NATO) – Science and Technology Organization.
   Google Scholar
• Reilly, T. J., Gebhardt, D. L., Billing, D. C., Greeves, J. P., & Sharp, M. A. (2015). Development and implementation of evidence based physical employment standards: Key challenges in the military context. Journal of Strength and Condition Research, 29(Suppl. 11), S28–S33. https://doi.org/10.1519/JSC.0000000000001105
   PubMedGoogle Scholar
• Research and Analysis Directorate. (2018). TRADOC center for initial military training: Attrition summary initial entry training. TRADOC Center for Initial Military Training.
   Google Scholar
• Riebe, D., Ehrman, J., Liguori, G., & Magal, M. (2018). ACSM’s guidelines for exercise testing and prescription (10th ed.). Wolters Kluwer.
   Google Scholar
• Robson, S., Lytell, M. C., Atler, A., Campbell, J. H., & Sims, C. S. (2020). Physical task simulations: Performance measures for the validation of physical tests and standards for Battlefield Airmen. RAND Corporation.
   Google Scholar
• Robson, S., Pezard, S., Lytell, M. C., Sims, C. S., Boon, J. E., Etchegaray, J. M., … Linnenkohl, K. A. (2019). Evaluation of the strength Aptitude test and other fitness test to qualify Air Force recruits for physically demanding specialties. RAND Corporation.
   Google Scholar
• Roch, S. G., Woehr, D. J., Mishra, V., & Kieszczy, U. (2012). Rater training revisited: An updated meta-analytic review of frame-of-reference training. Journal of Occupational and Organizational Psychology, 85(2), 370–395. https://doi.org/10.1111/j.2044-8325.2011.02045.x
   Web of Science ®Google Scholar
• Sharp, M., Cohen, B., Boye, M., Foulis, S., Redman, J., Larcom, K., & Zambraski, E. (2017). U.S. Army physical demand study: Identification and validation of physically demanding tasks of combat arms occupations. Journal of Science and Medicine in Sport, 20(S4), S62–S67. https://doi.org/10.1016/j.jsams.2017.09.013
   PubMedGoogle Scholar
• Sharp, M., Foulis, S., Redmond, J., Canino, M., Cohen, B., Hauret, K., Frykman, P., & Zambraski, E. (2018). Longitudinal validation of the Occupational Physical Assessment Test (OPAT). (Report No. T18-05). U.S. Army Research Institute of Environmental Medicine.
   Google Scholar
• Sharp, M. A., Rossberger, M., & Knapik, J. (2019). Chapter 5: Common military task: Materials handling. In T. Reilly Ed., Combat integration: Implications for physical employment standards (STRO-TR-HFM-269). ( pp. 5-1–5-48). North American Treaty Organization(NATO) – Science and Technology Organization. Chair.
   Google Scholar
• Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428. https://doi.org/10.1037/0033-2909.86.2.420
   PubMed Web of Science ®Google Scholar
• Siddall, A. G., Stevenson, R. D., Turner, P. F., Stokes, K. A., & Bilzon, J. L. (2016). Development of role-related minimum cardiorespiratory fitness standards for firefighters and commanders. Ergonomics, 59(10), 1335–1343. https://doi.org/10.1080/00140139.2015.1135997
   PubMed Web of Science ®Google Scholar
• Smith, P. C., & Kendall, L. M. (1963). Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology, 47(2), 149–155. https://doi.org/10.1037/h0047060
   Web of Science ®Google Scholar
• Sothmann, M. S., Gebhardt, D. L., Baker, T. A., Kastello, G. M., & Sheppard, V. A. (2004). Performance requirements of physically strenuous occupations: Validating minimum standards for muscular strength and endurance. Ergonomics, 47(8), 864–875. https://doi.org/10.1080/00140130410001670372
   PubMed Web of Science ®Google Scholar
• Stockbrugger, B., Reilly, T., Blacklock, R., & Gagnon, P. (2018). Reliability of individual components of the Canadian Armed Forces physical employment stand. Applied Physiology and Nutrition, and Metabolism, 43(7), 663–668. https://doi.org/10.1139/apnm-2017-0650
   PubMed Web of Science ®Google Scholar
• Woehr, D. J. (1994). Understanding frame-of-reference training: The impact of training on the recall of performance information. Journal of Applied Psychology, 79(4), 525–534. https://doi.org/10.1037/0021-9010.79.4.525
   Web of Science ®Google Scholar
• Woehr, D. J., & Roch, S. (2012). Chapter 22: Supervisory performance ratings. In N. Schmitt (Ed.), Handbook of Assessment and Selection (pp. 517–531). Oxford University Press, Inc.
   Google Scholar
• Young, A. J., Sawka, M. N., & Pandolf, K. B. (1996). Chapter 7: Physiology of cold exposure. In B. M. Marriott & S. J. Carlson (Eds.), Nutritional needs in cold and high altitude environments: Applications for military personnel in field operations (pp. 127–148). National Academies Press (US).
   Google Scholar