Assessing the impact of school-based mentoring: Common problems and solutions associated with evaluating nonprescriptive youth development programs

References

• Bayer, A., Grossman, J. B., & DuBois, D. L. (2015). Using volunteer mentors to improve the academic outcomes of underserved students: The role of relationships. Journal of Community Psychology, 43(4), 408–429. doi:10.1002/jcop.21693
   Web of Science ®Google Scholar
• Bernstein, L., Rappaport, C. D., Olsho, L., Hunt, D., & Levin, M. (2009). Impact evaluation of the U.S. Department of Education’s Student Mentoring Program (NCEE 2009–4047). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education..
   Google Scholar
• Bowen, G. L., & Chapman, M. V. (1996). Poverty, neighborhood danger, social support, and the individual adaptation among at-risk youth in urban areas. Journal of Family Issues, 17(5), 641–666. doi:10.1177/019251396017005004
   Web of Science ®Google Scholar
• Bruce, M., & Bridgeland, J. (2014). The mentoring effect: Young people’s perspectives on the outcomes and availability of mentoring. A report for MENTOR: The national mentoring partnership. Civic Enterprises. Retrieved from http://www.mentoring.org/images/uploads/Report_TheMentoringEffect.pdf.
   Google Scholar
• Bud, R., & Hughes, I. (2009) The dodo bird verdict—Controversial, inevitable, and important: A commentary on 30 years of meta-analyses. Clinical Psychology and Psychotherapy, 16(6), 510–522. doi:10.1002/cpp.648
   PubMed Web of Science ®Google Scholar
• Catalano, R. F., Hawkins, J. D., Berglund, M. L., Pollard, J. A., & Arthur, M. W. (2002). Prevention science and positive youth development: Competitive or cooperative frameworks? Journal of Adolescent Health, 31(6), 230–239. doi:10.1016/S1054-139X(02)00496-2
   PubMed Web of Science ®Google Scholar
• Cavell, T. A., & Elledge, L. C. (2014). Mentoring and prevention science. In D. L. DuBois & M. J. Karcher (Eds.), Handbook of youth mentoring (2nd ed., pp. 29–42). Thousand Oaks, CA: Sage Publications.
   Google Scholar
• Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–20. doi:10.1007/s11020-005-1962-6
   PubMedGoogle Scholar
• Cooper, F. E. (2005). Mentoring programs funded by the federal government dedicated to disadvantaged youth: Issues and activities. Congressional Research Service. Retrieved from https://digital.library.unt.edu/ark:/67531/metadc810697/.
   Google Scholar
• DuBois, D. L., Doolittle, F., Yates, B. T., Silverthorn, N., & Tebes, J. K. (2006). Research methodology and youth mentoring. Journal of Community Psychology, 34(6), 657–676. doi:10.1002/jcop.20122
   Web of Science ®Google Scholar
• DuBois, D. L., Portillo, N., Rhodes, J. E., Silverthorn, N., & Valentine, J. C. (2011). How effective are mentoring programs for youth? A systematic assessment of the evidence. Psychological Science in the Public Interest, 12(2), 57–91. doi:10.1177/1529100611414806
   PubMed Web of Science ®Google Scholar
• Embry, D. D., & Biglan, A. (2008). Evidence-based kernels: Fundamental units of behavioral influence. Clinical Child and Family Psychology Review, 11(3), 75–113. doi:10.1007/s10567-008-0036-x
   PubMed Web of Science ®Google Scholar
• Fernandes-Alcantara, A. L. (2015). Vulnerable youth: Federal mentoring programs and issues. Congressional Research Service. Retrieved from https://digital.library.unt.edu/ark:/67531/metadc806698/m2/1/high_res_d/RL34306_2015Apr21.pdf.
   Google Scholar
• Fisher, S. R. A. (1935). The design of experiments. Edinburgh, Scotland: Oliver and Boyd.
   Google Scholar
• Fuchs, L. S., Fuchs, D., Craddock, C., Hollenbeck, K. N., Hamlett, C. L., & Schatschneider, C. (2008). Effects of small-group tutoring with and without validated classroom instruction on at-risk students’ math problem solving: Are two tiers of prevention better than one? Journal of Educational Psychology, 100(3), 491–509. doi:10.1037/0022-0663.100.3.491
   PubMed Web of Science ®Google Scholar
• Garmezy, N., & Masten, A. S. (1986). Stress, competence, and resilience: Common frontiers for therapist and psychopathologist. Behavior Therapy, 17(5), 500–521. doi:10.1016/S0005-7894(86)80091-0
   Web of Science ®Google Scholar
• Garringer, M., McQuillin, S., & McDaniel, H. (2017). Examining youth mentoring services across America: Findings from the 2016 Mentoring Program Survey. Boston, MA: MENTOR: The National Mentoring Partnership.
   Google Scholar
• Gearing, B. (2008). School based mentoring and academic achievement: Connecting students to the instructional program through mentoring relationships. Corpus Christi, TX: Texas A & M University.
   Google Scholar
• Gottfredson, D. C., Cook, T. D., Gardner, F. E., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015). Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: Next generation. Prevention Science, 16(7), 893–926. doi:10.1007/s11121-015-0555-x
   PubMed Web of Science ®Google Scholar
• Grossman, J. B., & Bulle, M. J. (2006). Review of what youth programs do to increase the connectedness of youth with adults. Journal of Adolescent Health, 39(6), 788–799. doi:10.1016/j.jadohealth.2006.08.004
   PubMed Web of Science ®Google Scholar
• Grossman, J. B., Chan, C. S., Schwartz, S. E. O., & Rhodes, J. E. (2012). The test of time in school-based mentoring: The role of relationship duration and re-matching on academic outcomes. American Journal of Community Psychology, 49(1–2), 43–54. doi:10.1007/s10464-011-9435-0
   PubMed Web of Science ®Google Scholar
• Grossman, J. B., & Garry, E. (1997). Mentoring: A proven delinquency prevention strategy. Juvenile Justice Bulletin. Retrieved from https://www.ncjrs.gov/pdffiles/164834.pdf.
   Google Scholar
• Herrera, C., Grossman, J. B., Kauh, T. J., Feldman, A. F., & McMaken, J. (2007). Making a difference in schools: The big brothers big sisters school-based mentoring impact study. Public/Private Ventures. Retrieved from http://files.bigsister.org/file/Making-a-Difference-in-Schools.pdf.
   Google Scholar
• Herrera, C., Grossman, J. B., Kauh, T. J., & McMaken, J. (2011). Mentoring in schools: An impact study of Big Brothers Big Sisters school-based mentoring. Child Development, 82(1), 346–361. doi:10.1111/j.1467-8624.2010.01559.x
   PubMed Web of Science ®Google Scholar
• Karcher, M. J. (2008). The study of mentoring in the learning environment (SMILE): A randomized evaluation of the effectiveness of school-based mentoring. Prevention Science, 9(2), 99–113. doi:10.1007/s11121-008-0083-z
   PubMed Web of Science ®Google Scholar
• Karcher, M. J., & Nakkula, M. J. (2010). Youth mentoring with a balanced focus, shared purpose, and collaborative interactions. New Directions for Student Leadership, 2010(126), 13–32. doi:10.1002/yd.347
   Google Scholar
• Krigel, S. W., Grobe, J. E., Goggin, K., Harris, K. J., Moreno, J. L., & Catley, D. (2017). Motivational interviewing and the decisional balance procedure for cessation induction in smokers not intending to quit. Addictive Behaviors, 64, 171–178. doi:10.1016/j.addbeh.2016.08.036
   PubMed Web of Science ®Google Scholar
• Lei, H., Nahum-Shani, I., Lynch, K., Oslin, D., & Murphy, S. A. (2012). A “SMART” design for building individualized treatment sequences. Annual Review of Clinical Psychology, 8, 21–48. doi:10.1146/annurev-clinpsy-032511-143152PMCJournal
   PubMed Web of Science ®Google Scholar
• Lerner, J. V., Bowers, E. P., Minor, K., Lewin-Bizan, S., Boyd, M. J., Mueller, M. K., … Lerner, R. M. (2013). Positive youth development: Processes, philosophies, and programs. In R. M. Lerner, M. A. Easterbrooks, J. Mistry, & I. B. Weiner (Eds.), (Editory-in-Chief), Comprehensive handbook of psychology: Developmental psychology (Vol. 6, pp. 365–392). Hoboken, NJ: Wiley.
   Google Scholar
• LoSciuto, L., Rajala, A. K., Townsend, T. N., & Taylor, A. S. (1996). An outcome evaluation of across ages: An intergenerational mentoring approach to drug prevention. Journal of Adolescent Research, 11(1), 116–129. doi:10.1177/0743554896111007
   Web of Science ®Google Scholar
• Mboka, A. K. (2012). University-sponsored school-based mentoring programs that target at-risk youth: A glimpse of student-mentors’ experiences and challenges. Kriminologija & Socijalna Integracija, 20(1), 83.
   Google Scholar
• MENTOR. (2015). Elements of effective practice for mentoring (4th ed.). Boston, MA: MENTOR: The National Mentoring Partnership.
   Google Scholar
• McQuillin, S., Smith, B., & Strait, G. (2011). Randomized evaluation of a single semester transitional mentoring program for first year middle school students: A cautionary result for brief, school‐based mentoring programs. Journal of Community Psychology, 39(7), 844–859. doi:10.1002/jcop.20475
   Web of Science ®Google Scholar
• McQuillin, S., Strait, G., & Saeki, E. (2015). Program support and value of training in mentors’ satisfaction and anticipated Continuation of school-based mentoring relationships. Mentoring and Tutoring: Partnership in Learning, 23(2), 133–148. doi:10.1080/13611267.2015.1047630
   Web of Science ®Google Scholar
• McQuillin, S., Strait, G., Smith, B., & Ingram, A. (2015). Brief instrumental school-based mentoring for first- and second-year middle school students: A randomized evaluation. Journal of Community Psychology, 43(7), 885–899. doi:10.1002/jcop.21719
   Web of Science ®Google Scholar
• McQuillin, S. D., & Lyons, M. D. (2016). Brief instrumental school-based mentoring for middle school students: Theory and impact. Advances in School Mental Health Promotion, 9(2), 73–89. doi:10.1080/1754730X.2016.1148620
   Web of Science ®Google Scholar
• McQuillin, S. D., Terry, J. D., Strait, G. G., & Smith, B. H. (2013). Innovation in school-based mentoring: Matching the context, structure and goals of mentoring with evidence-based practices. Advances in School Mental Health Promotion, 6(4), 280–294. doi:10.1080/1754730X.2013.832009
   Google Scholar
• Morrow, K. V., & Styles, M. B. (1995). Building relationships with youth in program settings: A study of big brothers/big sisters. Philadelphia, PA: Public/Private Ventures.
   Google Scholar
• Moyers, T. B., Rowell, L. N., Manuel, J. K., Ernst, D., & Houck, J. M. (2016). The Motivational Interviewing Treatment Integrity Code (MITI 4): Rationale, preliminary reliability and validity. Journal of Substance Abuse Treatment, 65, 36–42. doi:10.1016/j.jsat.2016.01.001
   PubMed Web of Science ®Google Scholar
• Nakkula, M. J., & Harris, J. T. (2013). Assessment of mentoring relationships. In D. L. DuBois & M. J. Karcher (Eds.), Handbook of youth mentoring (pp. 100–117). Thousand Oaks, CA: Sage.
   Google Scholar
• Nelson, M. C., Cordray, D. S., Hulleman, C. S., Darrow, C. L., & Sommer, E. C. (2012). A procedure for assessing intervention fidelity in experiments testing educational and behavioral interventions. The Journal of Behavioral Health Services & Research, 39(4), 374–396. doi:10.1007/s11414-012-9295-x
   PubMed Web of Science ®Google Scholar
• Parra, G. R., DuBois, D. L., Neville, H. A., Pugh‐Lilly, A. O., & Povinelli, N. (2002). Mentoring relationships for youth: Investigation of a process‐oriented model. Journal of community psychology, 30(4), 367–388. doi:10.1002/jcop.10016
   Web of Science ®Google Scholar
• Pryce, J. (2012). Mentor attunement: An approach to successful school-based mentoring relationships. Child & Adolescent Social Work Journal, 29, 285–305. doi:10.1007/s10560-012-0260-6
   Google Scholar
• Pryce, J., & Keller, T. E. (2012). An investigation of volunteer-student relationship trajectories within school-based youth mentoring programs. Journal of Community Psychology, 40(2), 228–248. doi:10.1002/jcop.20487
   Web of Science ®Google Scholar
• Randolph, K. A., & Johnson, J. L. (2008). School-based mentoring programs: A review of the research. Children & Schools, 30(3), 177–185. doi:10.1093/cs/30.3.177
   Google Scholar
• Rhodes, J., & DuBois, D. (2008). Mentoring relationships and programs for youth. Current Directions in Psychological Science, 17(4), 254–258.
   Web of Science ®Google Scholar
• Roth, J. L., & Brooks-Gunn, J. (2016). Evaluating youth development programs: Progress and promise. Applied Developmental Science, 20(3), 188–202. doi:10.1080/10888691.2015.1113879
   PubMed Web of Science ®Google Scholar
• Scales, P. C., & Gibbons, J. L. (1996). Extended family members and unrelated adults in the lives of young adolescents: A research agenda. Journal of Early Adolescence, 16, 365–389. doi:10.1177/0272431696016004001
   Web of Science ®Google Scholar
• Schwartz, S. E. O., Rhodes, J. E., Chan, C. S., & Herrera, C. (2011). The impact of school-based mentoring on youths with different relational profiles. Developmental Psychology, 47(2), 450–462. doi:10.1037/a0021379
   PubMed Web of Science ®Google Scholar
• Sechrest, L., West, S. G., Phillips, M., Redner, R., & Yeaton, W. H. (1979). Strength, and integrity of treatment: Some neglected problems in evaluation research. In L. Sechrest, (Eds.), Evaluation studies review annual (Vol. 4). Beverly Hills, CA: Sage.
   Google Scholar
• Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference (p. 18). Boston, MA: Houghton, Mifflin.
   Google Scholar
• Sipe, C. L. (2005). Toward a typology of mentoring. In D. L. DuBois & M. J. Karcher (Eds.), Handbook of youth mentoring. Thousand Oaks, CA: Sage.
   Google Scholar
• Weiler, L. M., Chesmore, A. A., Pryce, J., Haddock, S. A., & Rhodes, T. (2017). Mentor response to youth academic support-seeking behavior: Does attunement matter? Youth & Society, 0044118X1769723. doi:10.1177/0044118x17697235
   Web of Science ®Google Scholar
• Weiss, M. J., Bloom, H. S., & Brock, T. (2014). A conceptual framework for studying the sources of variation in program effects. Journal of Policy Analysis and Management, 33(3), 778–808. doi:10.1002/pam.21760
   Web of Science ®Google Scholar
• Wheeler, M., Keller, T., & Dubois, D. (2010). Review of three recent randomized trials of school-based mentoring. SRCD Social Policy Report, 24(3), 1–21.
   Google Scholar
• Wood, S., & Mayo-Wilson, E. (2012). School-based mentoring for adolescents: A systematic review and meta-analysis. Research on Social Work Practice, 22(3), 257–269. doi:10.1177/1049731511430836
   Web of Science ®Google Scholar