Lessons for career guidance from return-on-investment analyses in complex education-related fields

References

• Aabø, S. (2009). Libraries and return on investment (ROI): A meta-analysis. New LibraryWorld, 110(7/8), 311–324.
   Google Scholar
• Aos, S., Lieb, R., Mayfield, J., Miller, M. G., & Pennucci, A. (2004). Benefits and costs of prevention and early intervention programs for youth. Washington State Institute for Public Policy. https://www.ojp.gov/ncjrs/virtual-library/abstracts/benefits-and-costs-prevention-and-early-intervention-programs-youth.
   Google Scholar
• Beckman, L., & Svensson, M. (2015). The cost-effectiveness of the Olweus bullying prevention program: Results from a modelling study’. Journal of Adolescence, 45, 127–137. https://doi.org/10.1016/j.adolescence.2015.07.020
   PubMed Web of Science ®Google Scholar
• Beesley, A., Gulemetova, M., & DiFuccia, M. (2015). Georgia governor’s office of student achievement innovation fund SROI analysis final report. IMPAQ International.
   Google Scholar
• Belfield, C., Bowden, A. B., Klapp, A., Levin, H., Shand, R. D., & Zander, S. (2015). The economic value of social and emotional learning. Journal of Benefit-Cost Analysis, 6, 508–544. https://doi.org/10.1017/bca.2015.55
   Web of Science ®Google Scholar
• Bowden, A. B., Shand, R., Levin, H. M., Muroga, A., & Wang, A. (2020). An economic evaluation of the costs and benefits of providing comprehensive supports to students in elementary school. Prevention Science, 21(8), 1126–1135. https://doi.org/10.1007/s11121-020-01164-w
   PubMed Web of Science ®Google Scholar
• Careers Wales. (2021). Brighter futures: our vision 2021-2026. Cardiff: Careers Wales. https://careerswales.gov.wales/about-us/brighter-futures
   Google Scholar
• Castleman, B., & Goodman, J. (2018). Intensive college counseling and the enrollment and persistence of low-income students. Education Finance and Policy, 13(1), 19–41. https://doi.org/10.1162/edfp_a_00204
   Web of Science ®Google Scholar
• Cedefop. (2020). Call for papers. Towards European standards for monitoring and evaluation of lifelong guidance systems and services. cedefop.europa.eu/files/2020_11_16_call_for_papers_cedefop_careersmonitoring.pdf.
   Google Scholar
• Covacevich, C., Mann, A., Santos, C., & Champaud, J. (2021). Indicators of teenage career readiness: An analysis of longitudinal data from eight countries. OECD Education Working Papers, 258. https://doi.org/10.1787/cec854f8-en
   Google Scholar
• Crépon, B., Duflo, E., Gurgand, M., Rathelot, R., & Zamora, P. (2013). Do labor market policies have displacement effects? Evidence from a clustered randomized experiment. The Quarterly Journal of Economics, 128(2), 531–580. https://doi.org/10.1093/qje/qjt001
   Web of Science ®Google Scholar
• Engelman, A., Morgan, G., Ruthven, M., & Pugh, E. (2016). 2016 legislative report Colorado school counselor corps grant program. Colorado Department of Education. https://www.cde.state.co.us/postsecondary/2016-school-counselor-corps-grant-program.
   Google Scholar
• Evers, S., Goossens, M., de Vet, H., van Tulder, M., & Ament, A. (2005). Criteria list for assessment of methodological quality of economic evaluations: Consensus on health economic criteria. International Journal of Technology Assessment in Health Care, 21(2), 240–5. https://doi.org/10.1017/S0266462305050324
   PubMed Web of Science ®Google Scholar
• Fleissig, A. (2014). Return on investment from training programs and intensive services. Atlantic Economic Journal, 42(1), 39–51. https://doi.org/10.1007/s11293-013-9394-y
   Google Scholar
• Ford, R., Frenette, M., Nicholson, C., Kwakye, I., Hui, T., Hutchinson, J., Dobrer, S., Fowler, H., & Hebert, S. (2012). Future to discover: Post-secondary impacts report. Social Research and Demonstration Corporation. http://www.srdc.org/publications/Future-to-Discover-FTD–Post-secondary-Impacts-Report-details.aspx.
   Google Scholar
• Foster, E. M., Jones, D. E., & Conduct problems prevention research group (2006). Can a costly intervention be cost-effective? Archives of General Psychiatry, 63(11), 1284–1291. https://doi.org/10.1001/archpsyc.63.11.1284
   PubMed Web of Science ®Google Scholar
• Frontier Economics. (2021). The economic value of WorldSkills UK. WorldSkills UK.
   Google Scholar
• Gauge Ireland. (2012). Social return on investment – Final report (December 2012). e-Merge - An Initiative of the Mount Street Trust – Employment Initiative delivered by Ballymun Job Centre. Ballymun Job Centre.
   Google Scholar
• Gough, D., & Thomas, J. (2016). Systematic reviews of research in education: Aims, myths and multiple methods. Review of Education, 4(1), 84–102. https://doi.org/10.1002/rev3.3068
   Web of Science ®Google Scholar
• Hasluck, C., McKnight, A., & Elias, P. (2000). Evaluation of the new deal for lone parents: Early lessons from the Phase One Prototype - Cost-benefit and econometric analyses research report No. 110. Department of Social Security.
   Google Scholar
• HM Treasury. (2020). The green book: Central government guidance on appraisal and evaluation. https://www.gov.uk/government/publications/the-green-book-appraisal-and-evaluation-in-central-governent.
   Google Scholar
• Hollenbeck, K., & Huang, W. (2016). Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute Technical Report, 16-033. W.E. Upjohn Institute for Employment Research. https://doi.org/10.17848/tr16-033
   Google Scholar
• Hooley, T., & Godden, L. (2022). Theorising career guidance policymaking: Watching the sausage get made. British Journal of Guidance & Counselling, 50(1), 141–156. https://doi.org/10.1080/03069885.2021.1948503
   Web of Science ®Google Scholar
• Hooley, T., Percy, C., & Alexander, R. (2021). Exploring Scotland’s career ecosystem. Skills Development Scotland.
   Google Scholar
• Hooley, T., Sultana, R. G., & Thomsen, R. (2018). The neoliberal challenge to career guidance. Mobilising research, policy and practice around social justice. In T. Hooley, R. G. Sultana, & R. Thomsen (Eds.), Career guidance for social justice. Contesting neoliberalism. Routledge.
   Google Scholar
• House, R. (1996). Audit-mindedness’ in counselling: Some underlying dynamics. British Journal of Guidance & Counselling, 24(2), 277–283. https://doi.org/10.1080/03069889608260415
   Google Scholar
• Hughes, D., & Percy, C. (2022). Transforming careers support for young people and adults in northern Ireland. Department for the Economy. https://www.economy-ni.gov.uk/publications/transforming-careers-support-young-people-and-adults-northern-ireland.
   Google Scholar
• Huitsing, G., Barends, S., & Lokkerbol, J. (2020). Cost-benefit analysis of the KiVa anti-bullying program in The Netherlands. International Journal of Bullying Prevention, 2, 215–224. https://doi.org/10.1007/s42380-019-00030-w
   Google Scholar
• Husereau, D., Drummond, M., Petrou, S., et al. (2013). Consolidated health economic evaluation reporting standards (CHEERS) statement. Value Health, 16(2), e1–e5. https://doi.org/10.1016/j.jval.2013.02.010
   PubMed Web of Science ®Google Scholar
• ICF International. (2016). Social innovation fund – return on investment study for three national fund for workforce solutions (NFWS) workforce partnership programs in Ohio. ICF.
   Google Scholar
• IntoUniversity. (2010). Intouniversity social return on investment.
   Google Scholar
• Jadambaa, A., Graves, N., Cross, D., Pacella, R., Thomas, H., Scott, J., Cheng, Q., & Brain, D. (2021). Economic evaluation of an intervention designed to reduce bullying in Australian schools. Applied Health Economics and Health Policy, 20, 79–89. https://doi.org/10.1007/s40258-021-00676-y
   PubMed Web of Science ®Google Scholar
• Klapp, A., Belfield, C., Bowden, B., Levin, H., Shand, R. D., & Zander, S. (2017). A benefit-cost analysis of a long-term intervention on social and emotional learning in compulsory school. The International Journal of Emotional Education, 9, 3–19. https://repository.upenn.edu/cbcse/7/
   Google Scholar
• Krug, G., & Stephan, G. (2013). Is the contracting-out of intensive placement services more effective than provision by the PES? Evidence from a randomized field experiment. IZA Discussion Papers, 7403. Institute for the Study of Labor (IZA).
   Google Scholar
• Legood, R., Opondo, C., Warren, E., Jamal, F., Bonell, C., Viner, R., & Sadique, Z. (2021). Cost-utility analysis of a complex intervention to reduce school-based bullying and aggression: An analysis of the inclusive RCT. Value in Health, 24(1), 129–135. https://doi.org/10.1016/j.jval.2020.04.1839
   PubMed Web of Science ®Google Scholar
• Levin, H. M., McEwan, P. J., Belfield, C., Bowden, A. B., & Shand, R. (2018). Economic evaluation in education: Cost-effectiveness and benefit-cost analysis (3rd ed.). SAGE publications.
   Google Scholar
• Maibom, J., Rosholm, M., & Svarer, M. (2017). Experimental evidence on the effects of early meetings and activation. The Scandinavian Journal of Economics, 119(3), 541–570. https://doi.org/10.1111/sjoe.12180
   Web of Science ®Google Scholar
• Mann, A, Denis, V, & Percy, C. (2020). Career ready? How schools can better prepare young people for working life in the era of COVID-19 (OECD Education Working Paper 241). Paris: OECD. https://doi.org/10.1787/e1503534-en
   Google Scholar
• Michaelides, M., Poe-Yamagata, E., Benus, J., & Tirumalasetti, D. (2012). Impact of the reemployment and eligibility assessment (REA) initiative in Nevada. IMPAQ International.
   Google Scholar
• OECD. (2004). Career guidance: A handbook for policy makers. OECD Publications.
   Google Scholar
• Osikominu, A. (2013). Quick job entry or long-term human capital development? The dynamic effects of alternative training schemes. Review of Economic Studies, 80(1), 313–342. https://doi.org/10.1093/restud/rds022
   Web of Science ®Google Scholar
• Oxford Economics. (2008). Examining the impact and value of EGSA to the NI economy: Final report.
   Google Scholar
• Page, L., Iriti, J., Lowry, D., & Anthony, A. (2019). The promise of place-based investment in postsecondary access and success: Investigating the impact of the Pittsburgh promise. Education Finance and Policy, 14(4), 572–600. https://doi.org/10.1162/edfp_a_00257
   Web of Science ®Google Scholar
• Pathak, P., & Dattani, P. (2014). Social return on investment: Three technical challenges. Social Enterprise Journal, 4(1), 3–18. https://doi.org/10.1332/204080513X661554
   Google Scholar
• Percy, C. (2020). Personal guidance in English secondary education: An initial return-on-investment estimate. The Careers & Enterprise Company.
   Google Scholar
• Percy, C. (2023). Quantifying the economic impact of career guidance in secondary education. [PhD Thesis, University of Derby]. UDORA. https://doi.org/10.48773/9x456
   Google Scholar
• Percy, C., & Dodd, V. (2021). The economic outcomes of career development programmes. In P. Robertson, T. Hooley, & P. McCash (Eds.), The Oxford handbook of career development (pp. 35–48). Oxford University Press.
   Google Scholar
• Percy, C., & Hughes, D. (2022). Lifelong guidance and welfare to work in Wales: Linked return on investment methodology. In F. Cedefop (Ed.), Towards European standards for monitoring and evaluation of lifelong guidance systems and services (Vol. I, pp. 109–138). Publications Office of the European Union. Cedefop. http://data.europa.eu/doi/10.2801/422672.
   Google Scholar
• Percy, C., & Tanner, E. (2021). The benefits of Gatsby Benchmark achievement for post-16 destinations. The Careers & Enterprise Company.
   Google Scholar
• Public Health England. (2018). Creating a logic model for an intervention: evaluation in health and wellbeing. https://www.gov.uk/guidance/evaluation-in-health-and-wellbeing-creating-a-logic-model.
   Google Scholar
• Ravulo, J., Said, S., Micsko, J., & Purchase, G. (2019). Utilising the social return on investment (SROI) framework to gauge social value in the fast forward program. Education Sciences, 9(4), 290. https://doi.org/10.3390/educsci9040290
   Web of Science ®Google Scholar
• Robertson, P. J. (2021). The aims of career development policy: Towards a comprehensive framework. In P. J. Robertson, T. Hooley, & P. McCash (Eds.), The Oxford handbook of career development (pp. 113–128). Oxford University Press.
   Google Scholar
• Swain-Bradway, J., Lindstrom Johnson, S., Bradshaw, C., & McIntosh, K. (2017). What are the economic costs of implementing SWPIBS in comparison to the benefits from reducing suspensions? PBIS Technical Assistance Center, University of Oregon. https://www.pbis.org/resource/what-are-the-economic-costs-of-implementing-swpbis-in-comparison-to-the-benefits-from-reducing-suspensions.
   Google Scholar
• The Sutton Trust. (2010). The mobility manifesto: A report on cost-effective ways to achieve greater social mobility through education.
   Google Scholar
• Trapp, N., Schneider, U., Mccallum, I., Fritz, S., Schill, C., Borzacchiello, M., Heumesser, C., & Craglia, M. (2015). A meta-analysis on the return on investment of geospatial aata and systems: A multi-country perspective’. Transactions in GIS, 19(2), 169–187.
   Web of Science ®Google Scholar
• Turner, A. J., Sutton, M., Harrison, M., Hennessey, A., & Humphrey, N. (2020). Cost-effectiveness of a school-based social and emotional learning intervention: Evidence from a cluster-randomised controlled trial of the promoting alternative thinking strategies curriculum. Applied Health Economics and Health Policy, 18(April 2020), 271–285. https://doi.org/10.1007/s40258-019-00498-z
   PubMed Web of Science ®Google Scholar
• UNESCO & NCVER. (2020). Understanding the return on investment of TVET: A practical guide. United Nations Educational, Scientific and Cultural Organization & National Centre for Vocational Education Research.
   Google Scholar
• Van Reenen, J. (2001). No more skivvy schemes? Active labour market policies and the British new deal for the young unemployed in context. The Institute for Fiscal Studies.
   Google Scholar
• Watts, A. (1995). Applying market principles to the delivery of careers guidance services: A critical review. British Journal of Guidance & Counselling, 23(1), 69–81. https://doi.org/10.1080/03069889508258061
   Google Scholar
• WGCG (The Inter-Agency Working Group on Career Guidance). (2021). Investing in career guidance. https://www.etf.europa.eu/sites/default/files/2021-09/investing_in_career_guidance.pdf.
   Google Scholar
• WSIPP. (2019). Benefit-cost technical documentation (Dec 2019 edition). Washington State Institute for Public Policy.
   Google Scholar