The Validity of Occupational Performance Assessments: A Validity Generalization Meta-Analysis

REFERENCES

• Allen, C. K., Austin, S. L., David, S. K., Earhart, C. A., McCraith, D. B., & Riska-Williams, L. (2007). Allen cognitive level screen-5 (ACLS-5). Camarillo, CA: ACLS and LACLS Committee.
   Google Scholar
• American Journal of Occupational Therapy. (2007a). Traumatic brain injury: Critically appraised paper (CAP). Bethesda, MD: AOTA Press.
   Google Scholar
• American Journal of Occupational Therapy. (2007b). Traumatic brain injury: Critically appraised topic (CAT). Bethesda, MD: AOTA Press.
   Google Scholar
• American Occupational Therapy Association. (2008). Occupational therapy practice framework: Domain and process (2nd ed.). Bethesda, MD: AOTA Press.
   Google Scholar
• Amundson, S. (1995). Evaluation tool of children's handwriting. Homer, AK: O.T. Kids.
   Google Scholar
• Bailey, D., & Jackson, J. (2005). The occupational household financial management among lesbian couples. Journal of Occupational Science, 12(2), 57–68.
   Google Scholar
• Baron, K., Kielhofner, G., Goldhammer, V. & Wolenski, J. (1999). The occupational self assessment (OSA) (Version 1.0). Chicago, IL: Model of Human Occupation Clearinghouse, Department of Occupational Therapy, University of Illinois at Chicago.
   Google Scholar
• Baum, C. M., Connor, L. T., Morrison, T., Hahn, M., Dromerick, A. W., & Edwards, D. F. (2008). Reliability, validity, and clinical utility of the Executive Function Performance Test: A measure of executive function in a sample of people with stroke. American Journal of Occupational Therapy, 62, 446–455.
   PubMed Web of Science ®Google Scholar
• Baum, C. M., & Edwards, D. F. (2001). The activity card sort. St. Louis, MO: Washington University School of Medicine.
   Google Scholar
• Baum, C. M., Morrison, T., Hahn, M., & Edwards, D. F. (2003). Test manual: Executive function performance test. St. Louis, MO: Washington University.
   Google Scholar
• Chan, V. W., Chung, J. C., & Packer, T. L. (2006). Validity and reliability of the activity card sort–Hong Kong version. OTJR, Occupation, Participation, and Health, 26(4), 152–158.
   Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Corrigan, J. D., Smith-Knapp, K., & Granger, C. V. (1997). Validity of the functional independence measure for persons with traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 78(8), 828–834.
   PubMed Web of Science ®Google Scholar
• Dedding, C., Cardol, M., Eyssen, I. C., Dekker, J., & Beelen, A. (2004). Validity of the Canadian occupational performance measure: A client-centered outcome measurement. Clinical Rehabilitation, 18(6), 660–667.
   PubMed Web of Science ®Google Scholar
• Depoy, E., & Gitlin, L. (2011). Introduction to Research Understanding and Applying Multiple Strategies (3rd ed.). St. Louise: Elsevier Mosby.
   Google Scholar
• Duff, S., & Goyen, T. (2010). Reliability and validity of the evaluation tool of children's handwriting–cursive (ETCH–C) using the general scoring criteria. American Journal of Occupational Therapy, 64, 37–46.
   PubMed Web of Science ®Google Scholar
• Eakman, A. M. (2007). A reliability and validity study of the meaningful activity participation assessment. Doctoral Dissertation, University of Southern California, Los Angeles, California.
   Google Scholar
• Eklund, M., & Sandqvist, G. (2006). Psychometric properties of the Satisfaction with Daily Occupations (SDO) instrument and the Manchester Short Assessment of Quality of Life (MANSA) in women with scleroderma and without known illness. Scandinavian Journal of Occupational Therapy, 13, 23–30.
   PubMedGoogle Scholar
• Ferguson, C. J. (2009). An effect size primer: A guide for clinicians and researchers. Professional Psychology: Research and Practice, 40(5), 532–538.
   Web of Science ®Google Scholar
• Fioravanti, A. M., Bordignon, C. M., Pettit, S. M., Woodhouse, L. J., & Ansley, B. J. (2012). Comparing the responsiveness of the Assessment of Motor and Process Skills and the Functional Independence Measure. Canadian Journal of Occupational Therapy, 79, 167–174.
   PubMed Web of Science ®Google Scholar
• Fisher, A. G. (2003). Assessment of motor and process skills volume 1: Development, standardization and administration manual (6th ed.). Fort Collins, CO: Three Star Press.
   Google Scholar
• Gage, M., Noh, S., Polatajko, H. J., & Kaspar, V. (1994). Measuring perceived self-efficacy in occupational therapy. American Journal of Occupational Therapy, 48, 783–790.
   PubMed Web of Science ®Google Scholar
• Granger, C. V., Cotter, A. C., Hamilton, B. B., & Fielder, R. C. (1993). Functional assessment scales: A study of persons after stroke. Archives of Physical Medicine and Rehabilitation, 74(2), 133–138.
   PubMed Web of Science ®Google Scholar
• Granger, C. V., Cotter, A. C., Hamilton, B. B., Fielder, R. C., & Hens, M. M. (1990). Functional assessment scales: A study of persons with multiple sclerosis. Archives of Physical Medicine and Rehabilitation, 71(11), 870–875.
   PubMed Web of Science ®Google Scholar
• Granger, C. V., Divan, N., & Fielder, R. C. (1995). Functional assessment scales: A study of persons after traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 74(2), 107–113.
   Google Scholar
• Hamed, R., & Holm, M. B. (2012). Psychometric properties of the Arab heritage Activity Card Sort. Occupational Therapy International, 20, 23–34.
   PubMedGoogle Scholar
• Hamera, E., & Brown, C. E. (2000). Developing a context-based performance measure for persons with schizophrenia: The Test of Grocery Shopping Skills. American Journal of Occupational Therapy, 54, 20–25.
   PubMed Web of Science ®Google Scholar
• Hartman-Maeir, A., Armon, N., & Katz, N. (2005). Kettle test protocol. Jerusalem: School of Occupational Therapy, Hadassah and Hebrew University of Jerusalem.
   Google Scholar
• Hartman-Maeir, A., Harel, H., & Katz, N. (2009). Kettle Test—A brief measure of cognitive functional performance: Reliability and validity in stroke rehabilitation. American Journal of Occupational Therapy, 64, 592–599.
   Google Scholar
• Ho, R. C., Ong, H. S., Kudva, K. G., Cheung, M. W., & Mak, A. (2010). How to critically appraise and apply meta-analysis in clinical practice. International Journal of Rheumatic Diseases, 13, 294–299.
   PubMedGoogle Scholar
• Hunter, E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.
   Google Scholar
• Ikiugu, M., & Ciaravino, E. A. (2006). Assisting adolescents experiencing emotional and behavioral difficulties (EBD) transition to adulthood. International Journal of Psychosocial Rehabilitation, 10(2), 57–78.
   Google Scholar
• Ikiugu, M. N. (2004) Instrumentalism in occupational therapy: Guidelines for practice. International Journal of Psychosocial Rehabilitation, 8, 165–179.
   Google Scholar
• Ikiugu, M. N. (2012). The test–retest reliability and predictive validity of a battery of newly developed occupational performance assessments. Occupational Therapy in Mental Health, 28(1), 51–71.
   Google Scholar
• Ikiugu, M. N., & Anderson, L. M. (2009). The validity of occupational performance measurement in psychosocial occupational therapy: A meta-analysis using the validity generalization method. International Journal of Psychosocial Rehabilitation, 13(2), 77–91.
   Google Scholar
• Ikiugu, M. N., & Rosso, H. M. (2006). Understanding the occupational human being as a complex, dynamical, adaptive system. Occupational Therapy in Health Care, 19(4), 43–65.
   PubMedGoogle Scholar
• Jarman, J. (2010). What is occupation? Interdisciplinary perspectives on defining and classifying human activity. In C. Christiansen & A. Townsend (Eds.), Introduction to occupation: The art and science of living (2nd ed., pp. 81–98). Saddle River, NJ: Prentice Hall.
   Google Scholar
• Jenkinson, N., Ownsworth, T., & Shum, D. (2007). Utility of the Canadian Occupational Performance Measure in community-based brain injury rehabilitation. Brain Injury, 21(12), 1283–1294.
   PubMed Web of Science ®Google Scholar
• Kielhofner G (2009). Conceptual foundations of occupational therapy practice (4th ed.). Philadelphia, PA: F. A. Davis.
   Google Scholar
• Kim, H., & Colantonio, A. (2010). Effectiveness of rehabilitation in enhancing community integration after acute traumatic brain injury: A systematic review. American Journal of Occupational Therapy, 64, 709–719.
   PubMed Web of Science ®Google Scholar
• Kisamore, J. (2003). Validity generalization and transportability: An investigation of distributional assumptions of random-effects meta-analytic methods. (Doctoral dissertation). University of South Florida, Tampa, Florida.
   Google Scholar
• Kjeken, I., Slatkowski-Christensen, B., Kvien, T. K., & Uhlig, T. (2004). Norwegian version of the Canadian Occupational Performance Measure in patients with hand osteoarthritis: Validity, responsiveness, and feasibility. Arthritis and Rheumatism, 51, 709–715.
   PubMed Web of Science ®Google Scholar
• Kopec, J. A., & Esdaile, J. M. (1998). Occupational role performance in persons with back pain. Disability and Rehabilitation, 20, 373–379.
   PubMed Web of Science ®Google Scholar
• Kronenberg, F., Pollard, N., & Ramugondo, E. (2011). Courage to dance politics. In F. Kronenberg, N. Pollard, & D. Sakellariou (Eds.), Occupational therapies without borders –Volume 2 (pp. 1–17). London: Churchill Livingstone.
   Google Scholar
• Kuncel, N., Crede, M., Thomas, L. L., Klieger, D. M., Seiler, S. N., & Woo, S. E. (2005). A meta-analysis of the validity of the pharmacy college admission test (PCAT) and grade predictors of pharmacy student performance. American Journal of Pharmaceutical Education, 69(3), 339–347.
   Google Scholar
• Law, M., Baptiste, S., Carswell, A., McColl, M. A., Polatajko, H., & Pollock, N. (2005). Canadian occupational performance measure (4th ed.). Toronto, Ontario: Canadian Association of Occupational Therapists.
   Google Scholar
• Law, M., Baum, C., & Dunn, W. (2005). Measuring occupational performance: Supporting best practice in occupational therapy. Thorofare, NJ: Slack.
   Google Scholar
• Lyons, K. D., Li, Z., Tosteson, T. D., Meehan, K., & Ahles, T. A. (2010). Consistency and construct validity of the activity card sort (Modified) in measuring activity resumption after stem cell transplantation. American Journal of Occupational Therapy, 64, 562–569.
   PubMed Web of Science ®Google Scholar
• McColl, M. A., Paterson, M., Davies, D., Doubt, L., & Law, M. (2000). Validity and community utility of the Canadian Occupational Performance Measure. Canadian Journal of Occupational Therapy, 67(1), 22–30.
   PubMedGoogle Scholar
• McNulty, M. C., & Fisher, A. G. (2001). Validity of using the Assessment of Motor and Process Skills to estimate overall home safety in persons with psychiatric conditions. American Journal of Occupational Therapy, 55, 649–655.
   PubMed Web of Science ®Google Scholar
• Melville, L. L., & Nelson, D. L. (2001). Melville–Nelson self-identified goals assessment. Retrieved from http://www.utoledo.edu/healthsciences/depts/rehab_sciences/ot/pdfs/protocol.pdf
   Google Scholar
• Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, W., Knol, D. L., et al. (2010). COSMIN checklist manual. Amsterdam, Netherlands: EMGO Institute for Health and Care Research, University Medical Center, Amsterdam.
   Google Scholar
• Morison, M. T., Giles, G. M., Ryan, J. D., Baum, C. M., Dromeric, A. W., Polatajko, H. J., & Edwards, D. (2013). Multiple errands test –Revised (MET-R): A performance-based measure of executive function in people with mild cerebrovascular accident. American Journal of Occupational Therapy, 67, 460–468.
   PubMedGoogle Scholar
• Nilsen, D. M., Gillen, G., & Gordon, A. M. (2010). Use of mental practice to improve upper-limb recovery after stroke: A systematic review. American Journal of Occupational Therapy, 64, 695–708.
   PubMed Web of Science ®Google Scholar
• Odes, H., Noter, E., Nir, M. B., Marcus, D., Shamir, Y., & Nir, N. (2006). Validity and reliability of the MEDYN questionnaire for evaluation of functioning in mental health clients receiving occupational therapy. Australian Occupational Therapy Journal, 53, 117–126.
   Google Scholar
• Orellano, E. M. (2008). Occupational participation of older Puerto Rican adults: Reliability and validity of a Spanish version of the Activity Card Sort. Doctoral Dissertation, Nova South Eastern University, Fort-Lauderdale-Davie, Florida.
   Google Scholar
• Pate, R., Ross, R., Dowda, M., Trost, S. & Sirard, J. (2003). Validation of a 3-day Physical Activity Recall instrument in female youth. Pediatric Exercise Science, 15, 257–265.
   Web of Science ®Google Scholar
• Pernold, G., Tonqvist, E. W., Wiktorin, C., Mortimer, M., Karlsson, E., Kilbom, A., et al. (2002). Validity of occupational energy expenditure assessed by interview. American Industrial Hygiene Association Journal, 63(1), 29–33.
   Google Scholar
• Persson, E., Rivano-Fischer, M., & Eklund, M. (2004). Evaluation of changes in occupational performance among patients in a pain management program. Journal of Rehabilitation Medicine, 36, 85–91.
   PubMed Web of Science ®Google Scholar
• Raju, N. S., Drasgow, F., & Blitz, D. L. (2003). Maximum likelihood estimation in validity generalization with examples. Presented at the annual meeting of the Society for Industrial and Organizational Psychology, Orlando, Florida.
   Google Scholar
• Ripat, J., Etcheverry, E., Cooper, J., & Tate, R. (2001). A comparison of the Canadian Occupational Performance Measure and the Health Assessment Questionnaire. Canadian Journal of Occupational Therapy, 68(4), 247–53.
   PubMedGoogle Scholar
• Rochman, D. L., Ray, S. A., Kulich, R. J., Mehta, N. R., & Driscoll, S. (2008). Validity and utility of the Canadian Occupational Performance Measure as an outcome measure in a craniofacial pain center. Occupational Therapy Journal of Research: Occupation, Participation and Health, 28(1), 4–11.
   Google Scholar
• Sandqvist, J. L., Bjork, M. A., Gullberg, M. T., Henriksson, C. M., & Gerdle, B. U. (2009). Construct validity of the Assessment of Work Performance (AWP). Work, 32, 211–218. doi: 10.3233/WOR-2009-0807
   PubMedGoogle Scholar
• Schmidt, F. L., & Hunter, J. E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529–540.
   Web of Science ®Google Scholar
• Schmidt, F. L., Law, K., Hunter, J. E., Rothstein, H. R., Pearlman, K., & McDaniel, M. (1993). Refinement in validity generalization methods: Implications for the situation specificity hypothesis. Journal of Applied Psychology, 78(1), 3–12.
   Web of Science ®Google Scholar
• Shorten, A., & Shorten, B. (2013). What is meta-analysis? Evidence Based Nursing, 16(1), 3–4.
   PubMedGoogle Scholar
• Smallfield, S., Clem, K., & Myers, A. (2013). Occupational therapy interventions to improve the reading ability of older adults with low vision: A systematic review. American Journal of Occupational Therapy, 67, 288–295.
   PubMed Web of Science ®Google Scholar
• Stanley, R., Boshoff, K., & Dollman, J. (2007). The concurrent validity of the 3-day physical activity recall questionnaire administered to female adolescents aged 12–14 years. Australian Occupational Therapy Journal, 54, 294–302.
   Web of Science ®Google Scholar
• Stein, F., Rice, M. S., & Cutler, A. K. (2013). Clinical research in occupational therapy. Clifton Park, NY: Delmar.
   Google Scholar
• Stuber, C. J., & Nelson, D. L. (2010). Convergent validity of three occupational self-assessments. Physical and Occupational Therapy in Geriatrics, 28(1), 13–21.
   Google Scholar
• Terwee, C. B., Mokkink, L. B., Knol, D. L., Ostelo, R. W., Bouter, L. M., & de Vet, H. C. (2012). Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist. Quality of Life Research, 21(4), 651–657.
   PubMed Web of Science ®Google Scholar
• Wechsler, D. (2008/1939). The measurement of adult intelligence. Baltimore, MD: Williams & Wilkins.
   Google Scholar
• Wilson, B. N., Kaplan, B. J., Crawford, S. G., Campbell, A., & Dewey, D. (2000). Reliability and validity of a parent questionnaire on childhood motor skills. American Journal of Occupational Therapy, 54, 484–493.
   PubMed Web of Science ®Google Scholar
• Winkler, D., Unsworth, C., & Sloan, S. (2005). Time use following a severe traumatic brain injury. Journal of Occupational Science, 12(2), 69–81.
   Google Scholar
• Wolf, F. M. (1986). Meta-analysis. Sage University Paper Series on Quantitative Applications in the Social Sciences, 07-061. Newbury Park, CA: Sage.
   Google Scholar