Measurement Properties of Indirect Assessment Methods for Functional Behavioral Assessment: A Review of Research

References

• Achenbach, T. M. (1991). Integrative guide for the 1991 CBCL/4–18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry.
   Google Scholar
• Aiken, L. R. (1997). Psychological testing and assessment (9th ed.). Needham Heights, MA: Allyn & Bacon.
   Google Scholar
• Akande, A. (1994). The motivation assessment profiles of low-functioning children. Early Child Development and Care, 101, 101–107.
   Google Scholar
• Akande, A. (1998). Some South African evidence of the inter-rater reliability of the Motivation Assessment Scale. Educational Psychology, 18, 111–115.
   Google Scholar
• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
   Google Scholar
• Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice—Hall.
   Google Scholar
• Arndorfer, R. E., Miltenberger, R. G., Woster, S. H., Rortvedt, A. K., & Gaffaney, T. (1994). Home-based descriptive and experimental analysis of problem behaviors in children. Topics in Early Childhood Special Education, 14, 64–87.
   Web of Science ®Google Scholar
• Barnett, D. W., Lentz, F. E., Jr., & Macmann, G. (2000). Psychometric qualities of professional practice. In E. S. Shapiro & T. R. Kratochwill (Eds.), Behavioral assessment in schools: Theory, research, and clinical foundations (2nd ed., pp. 355–386). New York: Guilford Press.
   Google Scholar
• Barton-Arwood, S. M., Wehby, J. H., Gunter, P. L., & Lane, K. L. (2003). Functional behavior assessment rating scales: Intrarater reliability with students with emotional or behavioral disorders. Behavioral Disorders, 28, 386–400.
   Web of Science ®Google Scholar
• Beaver, B. R., & Busse, R. T. (2000). Informant reports: Conceptual and research bases of interviews with parents and teachers. In E. S. Shapiro & T. R. Kratochwill (Eds.), Behavioral assessment in schools: Theory, research, and clinical foundations (2nd ed., pp. 257—287). New York: Guilford Press.
   Google Scholar
• Bergan, J. R., & Kratochwill, T. R. (1990). Behavioral consultation and therapy. New York: Plenum Press.
   Google Scholar
• Bergan, J. R., & Tombari, M. L. (1971). The analysis of verbal interactions occurring during consultation. Journal of School Psychology, 13, 209–225.
   Web of Science ®Google Scholar
• Bihm, E. M., Kienlen, T. L., Ness, M. E., & Poindexter, A. R. (1991). Factor structure of the Motivation Assessment Scale for persons with mental retardation. Psychological Reports, 68, 1235–1238.
   PubMed Web of Science ®Google Scholar
• Bird, F., Dores, P., Moniz, D., & Robinson, F. (1989). Reducing severe aggression and self-injurious behavior with functional communication training: Direct, collateral and generalized results. American Journal of Mental Retardation, 94, 37–48.
   PubMedGoogle Scholar
• Bracken, B. A. (1987). Limitations of preschool instruments and standards for minimal levels of technical adequacy. Journal of Psychoeducational Assessment, 5, 313–326.
   Google Scholar
• Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7–18.
   PubMed Web of Science ®Google Scholar
• Cone, J. D. (1977). The relevance of reliability and validity for behavioral assessment. Behavior Therapy, 8, 427–430.
   Web of Science ®Google Scholar
• Cone, J. D. (1978). The behavioral assessment grid (BAG): A conceptual framework and a taxonomy. Behavior Therapy, 9, 882–888.
   Web of Science ®Google Scholar
• Cone, J. D. (1997). Issues in functional analysis in behavioral assessment. Behavioral Research and Therapy, 35, 259–275.
   PubMed Web of Science ®Google Scholar
• Cone, J. D. (1998). Psychometric considerations: Concepts, contents, and methods. In M. Hersen & A. S. Bellack (Eds.), Behavioral assessment: A practical handbook (4th ed., pp. 22–46). Boston: Allyn & Bacon.
   Google Scholar
• Conroy, M. A., Fox, J. J., Bucklin, A., & Good, W. (1996). An analysis of the reliability and stability of the Motivation Assessment Scale in assessing the challenging behaviors of persons with developmental disabilities. Education and Training in Mental Retardation and Developmental Disabilities, 31, 243–250.
   Google Scholar
• Cooper, H. M. (1998). Synthesizing research: A guide for literature reviews (3rd. ed). Thousand Oaks, CA: Sage.
   Google Scholar
• Crawford, J., Brockel, B., Schauss, S., & Miltenberger, R. G. (1992). A comparison of methods for the functional assessment of stereotypic behavior. Journal of the Association for Persons with Severe Handicaps, 17, 77–86.
   Web of Science ®Google Scholar
• Crone, D. A., & Horner, R. H. (2003). Building positive behavior support systems in schools: Functional behavioral assessment. New York: Guilford Press.
   Google Scholar
• Cunningham, E., & O'Neill, R. E. (2000). Comparison of results of functional assessment and analysis methods with young children with autism. Education and Training in Mental Retardation and Developmental Disabilities, 35, 406—414.
   Google Scholar
• Duker, P. C., & Sigafoos, J. (1998). The Motivation Assessment Scale: Reliability and construct validity across three topographies of behavior. Research in Developmental Disabilities, 19, 131–141.
   PubMed Web of Science ®Google Scholar
• Dunlap, G., Newton, J., S., Fox, L., Benito, N., & Vaughn, B. (2001). Family involvement in functional assessment and positive behavior support. Focus on Autism and Other Developmental Disabilities, 16, 215–221.
   Google Scholar
• Dunlap, G., White, R., Vera, A., Wilson, D., & Panacek, L. (1996). The effects of multi-component, assessment-based curricular modifications on the classroom behavior of children with emotional and behavioral disorders. Journal of Behavioral Education, 4, 481–500.
   Google Scholar
• Durand, V. M. (1997). Motivation Assessment Scale II: Test version. Unpublished instrument.
   Google Scholar
• Durand, V. M., & Carr, E. G. (1991). Functional communication training to reduce challenging behavior: Maintenance and application in new settings. Journal of Applied Behavior Analysis, 24, 251–264.
   PubMed Web of Science ®Google Scholar
• Durand, V. M., & Crimmins, D. B. (1988). Identifying the variables maintaining self-injurious behavior. Journal of Autism and Developmental Disorders, 18, 99–117.
   PubMed Web of Science ®Google Scholar
• Durand, V. M., & Crimmins, D. B. (1992). The Motivation Assessment Scale administrative guide. Topeka, KS: Monaco & Associates.
   Google Scholar
• Durand, V. M., Crimmins, D. B., Caulfield, M., & Taylor, J. (1989). Reinforcer assessment: I. Using problem behavior to select reinforcers. Journal of the Association for Persons With Severe Handicaps, 14, 113–126.
   Web of Science ®Google Scholar
• Durand, V. M., & Kishi, G. (1987). Reducing severe behavior problems among persons with dual sensory impairments: An evaluation of a technical assistance model. Journal of the Association for Persons with Severe Handicaps, 12, 2–10.
   Web of Science ®Google Scholar
• Ebel, R. (1961). Must all tests be valid? American Psychologist, 15, 546–553.
   Google Scholar
• Eckert, T. L., & Hintze, J. M. (2000). Behavioral conceptions and applications of acceptability: Issues related to service delivery and research methodology. School Psychology Quarterly, 15, 123–148.
   Web of Science ®Google Scholar
• Edwards, R. P. (2002). A tutorial for using the Functional Assessment Informant Record for Teachers. Proven Practice: Prevention and Remediation Solutions for Schools, 4, 31–33.
   Google Scholar
• Ehrhardt, K. E., Barnett, D. W., Lentz, F. E., Jr., Stollar, S. A., & Reifin, L. H. (1996). Innovative methodology in ecological consultation: Use of scripts to promote treatment acceptability and integrity. School Psychology Quarterly, 11, 149–168.
   Web of Science ®Google Scholar
• Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (rev. ed.). Cambridge, MA: MIT Press.
   Google Scholar
• Floyd, R. G., & Bose, J. E. (2003). A critical review of rating scales assessing emotional disturbance. Journal of Psychoeducational Assessment, 21, 43–78.
   Web of Science ®Google Scholar
• Foster, S. L., & Cone, J. D. (1995). Validity issues in clinical assessment. Psychological Assessment, 7, 248–260.
   Web of Science ®Google Scholar
• Gibson, A. K., Hetrick, W. P., Taylor, D. V., Sandman, C. A., & Touchette, P. (1995). Relating the efficacy of naltrexone in treating self-injurious behavior to the Motivation Assessment Scale. Journal of Developmental and Physical Disabilities, 7, 215–220.
   Web of Science ®Google Scholar
• Gresham, F. M. (1984). Behavioral interviews in school psychology: Issues in psychometric adequacy and research. School Psychology Review, 13, 17–25.
   Google Scholar
• Gresham, F. M. (2003). Establishing the technical adequacy of functional behavioral assessment: Conceptual and measurement challenges. Behavioral Disorders, 28, 282–298.
   Web of Science ®Google Scholar
• Gresham, F. M., & Davis, C. J. (1988). Behavioral interviews with teachers and parents. In E. S. Shapiro & T. R. Kratochwill (Eds.), Behavioral assessment in schools: Conceptual foundations and practical applications (pp. 455–493). New York: Guilford Press.
   Google Scholar
• Gresham, F. M., & Lopez, M. F. (1996). Social validation: A unifying concept for school-based consultation research and practice. School Psychology Quarterly, 11, 204–227.
   Web of Science ®Google Scholar
• Haim, A. (2003). The analysis and validation of the Motivation Assessment Scale-II Test Version: A structural equation model. Dissertation Abstracts International: Section B: The Sciences and Engineering, 63(10–B): 4903.
   Google Scholar
• Hammill, D. D., Brown, L., & Bryant, B. R. (1992). A consumer's guide to tests in print (2nd ed.). Austin, TX: PRO—ED.
   Google Scholar
• Haring, T. G., & Kennedy, C. H. (1990). Contextual control of problem behavior in students with severe disabilities. Journal of Applied Behavior Analysis, 23, 235–243.
   PubMed Web of Science ®Google Scholar
• Hartman, D. P., Roper, B. L., & Bradford, C. C. (1979). Some relationships between behavioral and traditional assessment. Journal of Behavioral Assessment, 1, 3–21.
   Google Scholar
• Hayes, S. C., Nelson, R. O., & Jarrett, R. B. (1987). The treatment utility of assessment: A functional approach to evaluating assessment quality. American Psychologist, 42, 963–974.
   PubMed Web of Science ®Google Scholar
• Haynes, S. N., & O'Brien, W. H. (2000). Principals and practice of behavioral assessment. New York: Kluwer Academic/Plenum.
   Google Scholar
• Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7, 238–247.
   Web of Science ®Google Scholar
• Individuals with Disabilities Education Act Amendments of 1997, (Pub L No. 105–17. 20 USC Chapter 33, Sections 1400 et seq. (Statute)
   Google Scholar
• Johnston, J. M., & Pennypacker, H. S. (1993). Strategies and tactics of behavioral research (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
   Google Scholar
• Kearney, C. A. (1994). Interrater reliability of the Motivation Assessment Scale: Another, closer look. Journal of the Association for Persons with Severe Handicaps, 19, 139–142.
   Web of Science ®Google Scholar
• Kern, L., Dunlap, G., Clarke, S., & Childs, K. E. (1994). Student-assisted functional assessment interview. Diagnostique, 19(2,3), 29–39.
   Google Scholar
• Kinch, C., Lewis-Palmer, T., Hagan-Burke, S., & Sugai, G. (2001). A comparison of teacher and student functional behavior assessment interview information from low-risk and high-risk classrooms. Education and Treatment of Children, 24, 480–494.
   Google Scholar
• Kraemer, H. C., Periyakoil, V. S., & Noda, A. (2002). Kappa coefficients in medical research. Statistics in Medicine, 21, 2109–2129.
   PubMed Web of Science ®Google Scholar
• Kratochwill, T. R., & Shapiro, E. S. (2000). Conceptual foundations of behavioral assessment in schools. In E. S. Shapiro & T. R. Kratochwill (Eds.), Behavioral assessment in schools: Theory, research, and clinical foundations (2nd ed., pp. 3–15). New York: Guilford Press.
   Google Scholar
• Kratochwill, T. R., & Stoiber, K. C. (2002). Evidence-based interventions in school psychology: Conceptual foundations of the Procedural and Coding Manual of Division 16 and the Society for the Study of School Psychology Task Force. School Psychology Quarterly, 17, 341–389.
   Web of Science ®Google Scholar
• Lawry, J. R., Storey, K., & Danko, C. D. (1993). Analyzing problem behaviors in the classroom: A case study of functional analysis. Intervention in School and Clinic, 29, 96–100.
   Google Scholar
• Lennox, D. B., & Miltenberger, R. G. (1989). Conducting a functional assessment of problem behavior in applied settings. Journal of the Association of Persons with Severe Handicaps, 14, 304–311.
   Web of Science ®Google Scholar
• Lewis, T. J., Scott, T., & Sugai, G. (1994). The Problem Behavior Questionnaire: A teacher-based assessment instrument to develop interventions to develop functional hypotheses of problem behavior in general education classrooms. Diagnostique, 19, 103–115.
   Google Scholar
• Lewis, T. J., & Sugai, G. (1996). Functional assessment of problem behaviors: A pilot investigation of the comparative and interactive effects of teacher and peer social attention on students in general education settings. School Psychology Quarterly, 11, 1–19.
   Web of Science ®Google Scholar
• Li, M. F., & Lautenschlager, G. (1997). Generalizability theory applied to categorical data. Educational and Psychological Measurement, 57, 813–822.
   Web of Science ®Google Scholar
• Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
   Google Scholar
• Merrell, K. W. (2003). Behavioral, social, and emotional assessment of children and adolescents. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). Washington, DC: American Council on Education.
   Google Scholar
• Messick, S. (1995). Validity of psychological assessment: Validity of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.
   Web of Science ®Google Scholar
• Nelson, R. O. (1983). Behavioral assessment: Past, present, and future. Behavioral Assessment, 5, 195–206.
   Google Scholar
• Nelson, R. O., Hay, I. R., & Hay, W. M. (1977). Comments on Cone's “The relevance of reliability and validity for behavioral assessment.” Behavior Therapy, 8, 427–430.
   Web of Science ®Google Scholar
• Nelson-Gray, R. O. (2003). Treatment utility of psychological assessment. Psychological Assessment, 15, 521–531.
   PubMed Web of Science ®Google Scholar
• Newton, J. T., & Sturmey, P. (1991). The Motivation Assessment Scale: Interrater reliability and internal consistency in a British sample. Journal of Mental Deficiency Research, 35, 472–474.
   PubMedGoogle Scholar
• Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw Hill.
   Google Scholar
• O'Neill, R. E., Horner, R. H., Ablin, R. W., Storey, K., & Sprague, J. R. (1990). Functional analysis of problem behaviors: A practical guide. Sycamore, IL: Sycamore.
   Google Scholar
• O'Neill, R. E., Horner, R. H., Ablin, R. W., Sprague, J. R., Storey, K., & Newton, J. S. (1997). Functional assessment and program development for problem behaviors: A practical handbook. New York: Brooks/Cole.
   Google Scholar
• Paclawskyj, T. R., Matson, J. L., Rush, K. S., Smalls, Y., & Vollmer, T. R. (2001). Assessment of the convergent validity of the Questions About Behavioral Function scale with analogue functional analysis and the Motivation Assessment Scale. Journal of Intellectual Disability Research, 45, 484–494.
   PubMed Web of Science ®Google Scholar
• Powers, D. A., & Xie, Y. (2000). Statistical methods for categorical data analysis. San Diego, CA: Academic Press.
   Google Scholar
• Reese, R. M., Richman, D. M., Zarcone, J., & Zarcone, T. (2003). Individualizing functional assessments for children with autism: The contribution of perseverative behavior and sensory disturbances to disruptive behavior. Focus on Autism and Other Developmental Disabilities, 18, 89–94.
   Google Scholar
• Reich, W. (2000). Diagnostic Interview for Children and Adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 39, 59–66.
   PubMed Web of Science ®Google Scholar
• Scotti, J. R., Schulman, D. E., & Hojnacki, R. M. (1994). Functional analysis and unsuccessful treatment of Tourette's syndrome in a man with profound mental retardation. Behavior Therapy, 25, 721–738.
   Web of Science ®Google Scholar
• Shogren, K. A., & Rojahn, J. (2003). Convergent reliability and validity of the Questions About Behavioral Function and the Motivation Assessment Scale: A replication study. Journal of Developmental and Physical Disabilities, 15, 367–375.
   Web of Science ®Google Scholar
• Shriver, M. D., Anderson, C. M., & Proctor, B. (2001). Evaluating the validity of functional behavior assessment. School Psychology Review, 30, 180–192.
   Web of Science ®Google Scholar
• Shriver, M. D., & Proctor, B. (2005). Social validity in disseminating functional behavior assessment technology: Research directions for meeting consumer needs. Manuscript submitted for publication.
   Google Scholar
• Sigafoos, J., Kerr, M., & Roberts, D. (1994). Interrater reliability of the Motivation Assessment Scale: Failure to replicate with aggressive behavior. Research in Developmental Disabilities, 15, 333–342.
   PubMed Web of Science ®Google Scholar
• Silva, F. (1993). Psychometric foundations and behavioral assessment. Newbury Park, CA: Sage.
   Google Scholar
• Singh, N. N., Donatelli, L. S., Best, A., Williams, E. E., Barrera, F. J., Lenz, M. W., Landrum, T. J., Ellis, C. R., & Moe, T. L. (1993). Factor structure of the Motivation Assessment Scale. Journal of Intellectual Disabilities Research, 37, 65–75.
   PubMed Web of Science ®Google Scholar
• Spreat, C., & Connelly, L. (1996). Reliability analysis of The Motivation Assessment Scale. American Journal of Mental Retardation, 100, 528–532.
   PubMedGoogle Scholar
• Sturmey, P. (1994a). Assessing the function of aberrant behaviors: A review of psychometric instruments. Journal of Autism and Developmental Disorders, 24, 293–304.
   PubMed Web of Science ®Google Scholar
• Sturmey, P. (1994b). Assessing the functions of self-in jurious behavior: A case of assessment failure. Journal of Behavior Therapy and Experimental Psychiatry, 25, 331–336.
   PubMed Web of Science ®Google Scholar
• Sugai, G., Lewis-Palmer, T., & Hagan-Burke, S. (2000). Overview of the functional behavioral assessment process. Exceptionality, 8(3), 149–160.
   Google Scholar
• Thompson, S., & Emerson, E. (1995). Inter-informant agreement on the Motivation Assessment Scale: Another failure to replicate. Mental Handicap Research, 8, 203–208.
   Google Scholar
• Vollmer, T. R., & Matson, J. L. (1999). Questions About Behavioral Function manual. Baton Rouge, LA: Scientific Publishers.
   Google Scholar
• Witt, J. C., Daly, E. M., & Noell, G. (2000). Functional assessments: A step-by-step guide to solving academic and behavior problems. Longmont, CO: Sopris West.
   Google Scholar
• Wolery, M. (2003, October). Single-subject methods: Utility for establishing evidence for practice. Paper presented at the 19th Annual International Conference on Young Children with Special Needs and Their Families, Washington, DC.
   Google Scholar
• Wolf, M. M. (1978). The case of subjective measurement or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11, 203–214.
   PubMed Web of Science ®Google Scholar
• Yarbrough, S. C., & Carr, E. G. (2000). Some relationships between informant assessment and functional analysis of problem behavior. American Journal of Mental Retardation, 105, 130–151.
   PubMedGoogle Scholar
• Yates, B. T., & Taub, J. (2003). Assessing the costs, cost-effectiveness, and cost-benefit of psychological assessment: We should, we can, here's how. Psychological assessment, 15, 478–495.
   PubMed Web of Science ®Google Scholar
• Zarcone, J. R., Rodgers, T. A., Iwata, B. A., Rourke, D. A., & Dorsey, M. F. (1991). Reliability analysis of the Motivation Assessment Scale: A failure to replicate. Research in Developmental Disabilities, 12, 349–360.
   PubMed Web of Science ®Google Scholar