Establishment of performance standards and a cut-score for the Canadian Forces Firefighter Physical Fitness Maintenance Evaluation (FF PFME)

References

• Angoff, W. H.1971. “Scale, Norms, and Equivalent Scores.” In Educational Measurement, edited by R. L.Thorndike. 2nd ed., 508–600. Washington, DC: American Council on Education.
   Google Scholar
• “Barr and Flannery vs Treasury Board (Department of National Defence), Grievance under the Public Service Staff Relations Act.” (G. Giguere, adjudicator)July 7, 2006.
   Google Scholar
• Brennan, R. L.2004. “A Manual for BB-CLASS: A Computer Program That Uses the Beta-Binomial Model for Classification Consistency and Accuracy.” http://www.education.uiowa.edu/centers/casma/home.
   Google Scholar
• Deakin, J. M., R. P.Pelot, J. M.Smith, J. M.Stevenson, L. A.Wolfe, S. W.Lee, S. P.Jaenen, S. A.Hughes, J. W.Dwyer, and A. D.Hayes. 1996. Development of a Bona Fide Physical Maintenance Standard for CF and DND Fire Fighters. Final Report Submitted to Canadian Forces Personnel Support Agency. Kingston: Queen's University.
   Google Scholar
• Docherty, D., L. Goulet, C. A. Gaul, P. McFadyen, and S. Petersen. 2007, April. Phase III (Final) Report: Development and Validation of a Physical Fitness Test and Maintenance Standards for Canadian Forces Diving Personnel. Final Report Submitted to Department of National Defence. Victoria: University of Victoria. https://www.cfmws.com/en/AboutUs/PSP/DFIT/Documents/Publications%20and%20Reports/Divers%20Physical%20Fitness%20Maintenance%20Standard.pdf.
   Google Scholar
• Fielding, D. W., G. G.Page, W. T.Rogers, C. C.O'Byrne, M.Schulzer, and K. G.Moody. 1996. “Standard Setting for a Test of Pharmacy Knowledge: Application in High-Stakes Testing.” American Journal of Pharmaceutical Education60: 20–29.
   Web of Science ®Google Scholar
• Gledhill, N., and V. K.Jamnik. 1992. “Development and Validation of a Fitness Screening Protocol for Firefighter Applicants.” Canadian Journal of Sport Sciences17: 199–206.
   PubMedGoogle Scholar
• Government of Canada. 2003. Bona Fide Occupational Requirements and Bona Fide Justifications under the Canadian Human Rights Act: The Implications of Meiorin and Grismer. Ottawa: Canadian Human Rights Commission.
   Google Scholar
• Hambleton, R. K.2001. “Setting Performance Standards on Educational Assessments and Criteria for Evaluating the Process.” In Setting Performance Standards: Concepts, Methods, and Perspectives, edited by G. J.Cizek, 89–116. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Hofstee, W. K. B.1983. “The case for compromise in educational selection and grading.” In On Educational Testing, edited by S. B.Anderson and J. S.Helmick, 109–127. San Francisco, CA: Jossey-Bass.
   Google Scholar
• International Association of Fire Fighters. 1997. Fire Service Joint Labor Management Wellness Fitness Initiative. Washington, DC: International Association of Fire Fighters.
   Google Scholar
• Jackson, A. S.1994. “Preemployment Physical Evaluation.” Exercise and Sport Science Reviews22: 53–90.
   PubMedGoogle Scholar
• Jamnik, V. K., R.Gumienak, and N.Gledhill. 2013. “Physiological Employment Standards II: Developing and Implementing Physical Employment Standards for Safety-Related Occupations.” European Journal of Applied Physiology113: 2447–2457.
   PubMed Web of Science ®Google Scholar
• Jamnik, V. K., S. G.Thomas, J. F.Burr, and N.Gledhill. 2010. “Construction, Validation and Derivation of Performance Standards for a Fitness Test for Correctional Officer Applicants.” Applied Physiology, Nutrition and Metabolism35 (1): 59–70.
   PubMed Web of Science ®Google Scholar
• Kane, M. T.2001. “So Much Remains the Same: Conception and Status of Validation in Setting Standards.” In Setting Performance Standards: Concepts, Methods, and Perspectives, edited by G. J.Cizek, 53–88. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Karantonis, A., and S.Sireci. 2006. “The Bookmark Standard-Setting Method: A Literature Review.” Educational Measurement: Issues and Practice25 (1): 4–12.
   Google Scholar
• Kingston, N. M., S. R.Kahl, K. P.Sweeney, and L.Bay. 2001. “Setting Performance Standards Using the Body of Work Method.” In Setting Performance Standards, edited by G. J.Cizek, 219–247. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Lewis, D. M., H. C.Mitzel, D. R.Green, and R. J.Patz. 1999. The Bookmark Standard Setting Procedure. Monterey, CA: McGraw-Hill.
   Google Scholar
• Linn, J.2006. “The Bookmark Procedure for Setting Cut-scores and Finalizing Performance Standards: Strengths and Weaknesses.” Alberta Journal of Educational Research52: 36–52.
   Google Scholar
• Livingstone, A. A., and M. J.Zieky. 1982. Passing Scores: A Manual for Setting Standards of Performance on Educational and Occupational Tests. Princeton, NJ: Educational Test Service.
   Google Scholar
• Maguire, T., E.Skakun, and C.Harley. 1992. “Setting Standards for Multiple-Choice Items in Clinical Reasoning.” Evaluation & the Health Professions15: 434–452.
   Web of Science ®Google Scholar
• Mitzel, H. C., D. M.Lewis, R. J.Patz, and D. R.Green. 2001. “The Bookmark Procedure: Psychological Perspectives.” In Setting Performance Standards: Concepts, Methods, and Perspectives, edited by G. J.Cizek, 249–281. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Nedelsky, L.1954. “Absolute Grading Standards for Objective Tests.” Educational and Psychological Measurement14: 3–19.
   Web of Science ®Google Scholar
• Payne, W., and J.Harvey. 2010. “A Framework for the Development of Physical Employment Tests and Standards.” Ergonomics53 (7): 858–871.
   PubMed Web of Science ®Google Scholar
• Petersen, S. R., D.Docherty, and W. T.Rogers. 2013. Revision of the Standard for the Canadian Forces Firefighter Physical Fitness Maintenance Evaluation (FF PFME). Report Submitted to the Department of National Defence. Edmonton: University of Alberta.
   Google Scholar
• Petersen, S. R., and R. W.Dreger. 2006. Development of Bona Fide Pre-Employment Physical Fitness Standards for Canadian Forces (CF) and Department of National Defence (DND) firefighters. Final Report Submitted to the Department of National Defence. Edmonton: University of Alberta.
   Google Scholar
• Petersen, S. R., T. C.Dreger, and T. C.Hartley. 2008. Development of a Forcible Entry Test for Firefighters. Final Report Submitted to the Department of National Defence. Edmonton: University of Alberta. https://www.cfmws.com/en/AboutUs/PSP/DFIT/Documents/Publications%20and%20Reports/FF%20Forcible%20Entry-Final%20Report.pdf.
   Google Scholar
• Petersen, S. R., M. K.Stickland, and D.Docherty. 2011. Development of Bona Fide Physical Fitness Standards for Canadian Forces (CF) Search and Rescue Technician (SAR-Tech) Applicants. Final Report Submitted to the Department of National Defence. Edmonton: University of Alberta. https://www.cfmws.com/en/AboutUs/PSP/DFIT/Documents/Publications%20and%20Reports/Search%20and%20Rescue%20Technicians%20Physical%20Fitness%20Selection%20Standard.pdf.
   Google Scholar
• Peterson, C. H., E. M.Schulz, and G.EngelhardJr. 2011. “Reliability and Validity of Bookmark-Based Methods for Standard Setting: Comparisons to Angoff-Based Methods in the National Assessment of Educational Progress.” Educational Measurement: Issues and Practice30 (2): 3–14.
   Google Scholar
• Plake, B. S., and R. K.Hambleton. 2000. “A Standard Setting Method Designed for Complex Performance Assessments: Categorical Assignment of Student Work.” Educational Assessment6: 197–215.
   Google Scholar
• Plake, B. S., and R. K.Hambleton. 2001. “The Analytic Judgment Method For Setting Standards on Complex Performance Assessments.” In Setting Performance Standards, edited by C. J.Cizek, 283–312. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Ricker, K. L.2006. “Setting Cutscores: Critical Review of Angoff and Modified-Angoff Methods.” Alberta Journal of Educational Measurement52: 53–64.
   Google Scholar
• Rogers, W. T., and T. B.Dawber. 2002. “Book Review of Setting Performance Standards: Concepts, Methods, and Perspectives.” International Journal of Testing2: 161–168.
   Google Scholar
• Rogers, W. T., and K. L.Ricker. 2006. “Establishing Performance Standards and Setting Cut-scores.” Alberta Journal of Education52: 16–24.
   Google Scholar
• Shephard, R. J.1994. “Occupational Demand and Human Rights: Public Safety Officers and Cardiorespiratory Fitness.” Sports Medicine12 (2): 94–109.
   Web of Science ®Google Scholar
• Sothmann, M. S., D. L.Gebhardt, T. A.Baker, G. M.Kastello, and V. A.Sheppard. 2004. “Performance Requirements of Physically Strenuous Occupations: Validating Minimum Standards for Muscular Strength and Endurance.” Ergonomics47 (8): 864–875.
   PubMed Web of Science ®Google Scholar
• Tipton, M. J., G. S.Milligan, and T. J.Reilly. 2013. “Physiological Employment Standards I. Occupational Fitness Standards: Objectively Subjective?” European Journal of Applied Physiology113: 2435–2446.
   PubMed Web of Science ®Google Scholar