Developing a Measurement of Child Welfare Policy and Practice: Local Supervisory Review Instrument

Abstract

As child welfare systems move toward evidence-based practice, one state implemented a statewide program to amass data on child welfare outcomes and child welfare workers’ performance. This measurement tool, called the Local Supervisory Review Instrument (LSRI), was used on the individual level to provide feedback to case workers as well as on a county and statewide basis to monitor trends on select indicators of child safety, permanency and well-being. The purpose of this study is to review the design and development of the LSRI, including data from throughout the state and to examine a reliability analysis of the instrument. For the differing program areas of the LSRI, descriptive statistics were used to assess response rates and mean rating score. Cronbach's alpha (α) for internal consistency was used to assess the reliability of the LSRI. The results indicate that the reliability of the LSRI is moderate or high, although there are significant exceptions as well. With revisions of some items, the LSRI can contribute to building a model for other states to increase data driven outcomes and workers’ assessments in the field of child welfare.

Keywords:

• measurement of child welfare
• reliability analysis

ACKNOWLEDGEMENTS

This research was supported by a contract with a mid-Atlantic state child welfare agency. We extend our gratitude to the supervisor and workers who contributed to this study by providing valuable information.