Developments in the Reporting of Score Reliability within Counseling Assessment, Research, and Evaluation

References

• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (Eds.). (2014). Standards for educational and psychological testing. American Educational Research Association.
   Google Scholar
• American Psychological Association. (2019). Publication manual of the American Psychological Association (7th ed.). American Psychological Association.
   Google Scholar
• Balkin, Q., Hunter, B. T., & Erford, R. S. (2024). Reliable for whom? Inferring and reporting reliability across diverse populations. Measurement and Evaluation in Counseling and Development, 57(2), 1–10. https://doi.org/10.1080/07481756.2023.2301286
   PubMedGoogle Scholar
• Balkin, R. S., & Kleist, D. (2022). Counseling research: A practitioner-scholar approach (2nd ed.). American Counseling Association.
   Google Scholar
• Barrio Minton, C. A., & Lenz, A. S. (2019). Practical approaches to applied research and program evaluation for helping professionals. Routledge.
   Google Scholar
• Baugh, F. (2002). Correcting effect sizes for score reliability: A reminder that measurement and substantive issues are linked inextricably. Educational and Psychological Measurement, 62(2), 254–263. https://doi.org/10.1177/0013164402062002004
   Web of Science ®Google Scholar
• Coleman, M. L., Ragan, M., & Dari, T. (2024). Intercoder reliability for use in qualitative research and evaluation. Measurement and Evaluation in Counseling and Development, 57(2), 1–11. https://doi.org/10.1080/07481756.2024.2303715
   PubMedGoogle Scholar
• Cook, R. M., & Wind, S. A. (2024). Item response theory: A modern measurement approach to reliability and precision for counseling researchers. Measurement and Evaluation in Counseling and Development, 57(2), 1–20. https://doi.org/10.1080/07481756.2023.2301284
   PubMedGoogle Scholar
• Fan, X., & Thompson, B. (2001). Confidence intervals about score reliability coefficients, please: An EPM Guidelines editorial. Educational and Psychological Measurement, 61(4), 517–531. https://doi.org/10.1177/00131640121971365
   Web of Science ®Google Scholar
• Henson, R. K. (2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34(3), 177–189. https://doi.org/10.1080/07481756.2002.12069034
   Web of Science ®Google Scholar
• Henson, R. K., & Thompson, B. (2002). Characterizing measurement error in scores across studies: Some recommendations for conducting "reliability generalization" studies. Measurement and Evaluation in Counseling and Development, 35(2), 113–127. https://doi.org/10.1080/07481756.2002.12069054
   Web of Science ®Google Scholar
• Kalkbrenner, M. T. (2024). Choosing between Cronbach’s coefficient alpha, McDonald’s coefficient omega, and coefficient H: Confidence intervals and the advantages and drawbacks of interpretive guidelines. Measurement and Evaluation in Counseling and Development, 57(2), 1–13. https://doi.org/10.1080/07481756.2023.2283637
   PubMedGoogle Scholar
• Lenz, A. S., Ault, H., Balkin, R. S., Barrio Minton, C. A., Erford, B. T., Hays, D. G., Kim, B. S. K., & Li, C. (2022). Responsibilities of users of standardized tests (RUST-4E). Measurement and Evaluation in Counseling and Development, 55(4), 227–235. https://doi.org/10.1080/07481756.2022.2052321
   Web of Science ®Google Scholar
• Lenz, A. S., Smith, C., & Meegan, A. (in press). A reliability generalization meta-analysis of scores on the Professional Quality of Life (ProQOL) Scale across sample characteristics. Measurement and Evaluation in Counseling and Development, https://doi.org/10.1080/07481756.2024.2320154.
   Web of Science ®Google Scholar
• McKay, M., Healy, C., & O'Donnell, L. (2021). The Adolescent and Adult Time Inventory-Time Attitudes Scale: A comprehensive review and meta-analysis of psychometric studies. Journal of Personality Assessment, 103(5), 576–587. https://doi.org/10.1080/00223891.2020.1818573
   PubMed Web of Science ®Google Scholar
• Miller, C. S., Woodson, J., Howell, R. T., & Shields, A. L. (2009). Assessing the reliability of scores produced by the substance abuse subtle screening inventory. Substance Use & Misuse, 44(8), 1090–1100. https://doi.org/10.1080/10826080802486772
   PubMed Web of Science ®Google Scholar
• Onwuegbuzie, A. J., & Daniel, L. G. (2002). A framework for reporting and interpreting internal consistency reliability estimates. Measurement and Evaluation in Counseling and Development, 35(2), 89–103. https://doi.org/10.1080/07481756.2002.12069052
   Web of Science ®Google Scholar
• Sheperis, C. J., Young, J. S., & Daniels, M. H. (2023). Counseling research: Quantitative, qualitative, and mixed methods (3rd. ed.) Pearson.
   Google Scholar
• Thompson, B., & Snyder, P. A. (1998). Statistical significance and reliability analyses in recent Journal of Counseling & Development research articles. Journal of Counseling & Development, 76(4), 436–441. https://doi.org/10.1002/j.1556-6676.1998.tb02702.x
   Web of Science ®Google Scholar
• Thompson, B., & Vacha-Haase, T. (2000). Psychometrics is datametrics: The test is not reliable. Educational and Psychological Measurement, 60(2), 174–195. https://doi.org/10.1177/00131640021970448
   Web of Science ®Google Scholar
• Vacha-Haase, T., Kogan, L. R., & Thompson, B. (2003). Sample compositions and variabilities in published studies versus those in test manuals. In B. Thompson (Ed.), Score reliability: Contemporary thinking on reliability issues (pp. 157–172). Sage Publications, Inc.
   Google Scholar
• Vincent, M., Rubio-Aparicio, M., Sánchez-Meca, J., & Gonzálvez, C. (2019). A reliability generalization meta-analysis of the child and adolescent perfectionism scale. Journal of Affective Disorders, 245, 533–544. https://doi.org/10.1016/j.jad.2018.11.049
   PubMed Web of Science ®Google Scholar
• Wester, K. L., & Wachter Morris, C. A. (2018). Making research relevant: Applied research designs for the mental health practitioner. Routledge.
   Google Scholar
• Yin, P., & Fan, X. (2000). Assessing the reliability of the Beck Depression Inventory scores: Reliability generalization across studies. Educational and Psychological Measurement, 60(2), 201–223. https://doi.org/10.1177/00131640021970466
   Web of Science ®Google Scholar