Measuring the efficiency of universities: what is inside the black box?

References

• Abbott, M., & Doucouliagos, C. (2003). The efficiency of Australian universities: A data envelopment analysis. Economics of Education Review, 22(1), 89–97.
   Web of Science ®Google Scholar
• Agasisti, T., Abalmasova, E., Shibanova, E., & Egorov, A. (2021) The causal impact of performance-based funding on university performance: Quasi-experimental evidence from a policy in Russian higher education. Oxford Economic Papers. (in press).
   Google Scholar
• Agasisti, T., Barra, C., & Zotti, R. (2016). Evaluating the efficiency of Italian public universities (2008–2011) in presence of (unobserved) heterogeneity. Socio-Economic Planning Sciences, 55, 47–58. https://doi.org/10.1016/j.seps.2016.06.002
   Web of Science ®Google Scholar
• Agasisti, T., & Dal Bianco, A. (2006). Data envelopment analysis to the Italian university system: Theoretical issues and policy implications. International Journal of Business Performance Management, 8(4), 344–367. https://doi.org/10.1504/IJBPM.2006.009613
   Google Scholar
• Agasisti, T., Egorov, A., & Maximova, M. (2021). Do merger policies increase universities’ efficiency? Evidence from a fuzzy regression discontinuity design. Applied Economics, 53(2), 185–204. https://doi.org/10.1080/00036846.2020.1803488
   Web of Science ®Google Scholar
• Agasisti, T., Egorov, A., & Serebrennikov, P. (2023). Universities’ efficiency and the socioeconomic characteristics of their environment — evidence from an empirical analysis. Socio-Economic Planning Sciences, 85, 101445. https://doi.org/10.1016/j.seps.2022.101445
   Web of Science ®Google Scholar
• Agasisti, T., & Johnes, G. (2009). Beyond frontiers: Comparing the efficiency of higher education decision‐making units across more than one country. Education Economics, 17(1), 59–79. https://doi.org/10.1080/09645290701523291
   Google Scholar
• Agasisti, T., & Johnes, G. (2010). Heterogeneity and the evaluation of efficiency: The case of Italian universities. Applied Economics, 42(11), 1365–1375. https://doi.org/10.1080/00036840701721463
   Web of Science ®Google Scholar
• Agasisti, T., & Pérez-Esparrells, C. (2010). Comparing efficiency in a cross-country perspective: The case of Italian and Spanish state universities. Higher Education, 59(1), 85–103. https://doi.org/10.1007/s10734-009-9235-8
   Web of Science ®Google Scholar
• Agasisti, T., Shibanova, E., Platonova, D., & Lisyutkin, M. (2020). The Russian excellence initiative for higher education: A nonparametric evaluation of short‐term results. International Transactions in Operational Research, 27(4), 1911–1929. https://doi.org/10.1111/itor.12742
   Web of Science ®Google Scholar
• Aigner, D., Lovell, C. K., & Schmidt, P. (1977). Formulation and estimation of stochastic frontier production function models. Journal of Econometrics, 6(1), 21–37. https://doi.org/10.1016/0304-4076(77)90052-5
   Google Scholar
• Aubyn, M.S., Garcia, F., & Pais, J. (2009). Study on the efficiency and effectiveness of public spending on tertiary education (No. 390). In Directorate general economic and financial affairs (DG ECFIN). European Commission.
   Google Scholar
• Bădin, L., Daraio, C., & Simar, L. (2010). Optimal bandwidth selection for conditional efficiency measures: A data-driven approach. European Journal of Operational Research, 201(2), 633–640. https://doi.org/10.1016/j.ejor.2009.03.038
   Web of Science ®Google Scholar
• Bădin, L., Daraio, C., & Simar, L. (2019). A bootstrap approach for bandwidth selection in estimating conditional efficiency measures. European Journal of Operational Research, 277(2), 784–797. https://doi.org/10.1016/j.ejor.2019.02.054
   Web of Science ®Google Scholar
• Barra, C., & Zotti, R. (2017). Investigating the human capital development–growth Nexus: Does the efficiency of universities matter? International Regional Science Review, 40(6), 638–678. https://doi.org/10.1177/0160017615626215
   Web of Science ®Google Scholar
• Bolli, T., Olivares, M., Bonaccorsi, A., Daraio, C., Aracil, A. G., & Lepori, B. (2016). The differential effects of competitive funding on the production frontier and the efficiency of universities. Economics of Education Review, 52, 91–104. https://doi.org/10.1016/j.econedurev.2016.01.007
   Web of Science ®Google Scholar
• Bradley, S., Johnes, J., & Little, A. (2010). Measurement and determinants of efficiency and productivity in the further education sector in England. Bulletin of Economic Research, 62(1), 1–30. https://doi.org/10.1111/j.1467-8586.2009.00309.x
   Web of Science ®Google Scholar
• Cai, Y., & Yang, X. (2016). Mergers in Chinese higher education: Lessons for studies in a global context. European Journal of Higher Education, 6(1), 71–85. https://doi.org/10.1080/21568235.2015.1099458
   Google Scholar
• Cave, M. (1997). The use of performance indicators in higher education: The challenge of the quality movement. Jessica Kingsley Publishers.
   Google Scholar
• Cazals, C., Florens, J. P., & Simar, L. (2002). Nonparametric frontier estimation: A robust approach. Journal of Econometrics, 106(1), 1–25. https://doi.org/10.1016/S0304-4076(01)00080-X
   Web of Science ®Google Scholar
• Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2(6), 429–444. https://doi.org/10.1016/0377-2217(78)90138-8
   Web of Science ®Google Scholar
• Daraio, C., & Simar, L. (2005). Introducing environmental variables in nonparametric frontier models: A probabilistic approach. Journal of Productivity Analysis, 24(1), 93–121. https://doi.org/10.1007/s11123-005-3042-8
   Web of Science ®Google Scholar
• Daraio, C., Simar, L., & Wilson, P. W. (2020). Fast and efficient computation of directional distance estimators. Annals of Operations Research, 288(2), 805–835. https://doi.org/10.1007/s10479-019-03163-9
   Web of Science ®Google Scholar
• Daraio, C., Simar, L., & Wilson, P. W. (2021). Quality as a latent heterogeneity factor in the efficiency of universities. Economic Modelling, 99, 105485. https://doi.org/10.1016/j.econmod.2021.03.004
   Web of Science ®Google Scholar
• De Witte, K., & López-Torres, L. (2017). Efficiency in education: A review of literature and a way forward. The Journal of the Operational Research Society, 68(4), 339–363. https://doi.org/10.1057/jors.2015.92
   Web of Science ®Google Scholar
• Douglass, J.A. (Ed.). (2016). The new flagship university: Changing the paradigm from global ranking to national relevancy. Springer.
   Google Scholar
• Egorov, A., Leshukov, O., & Froumin, I. (2020). “Regional flagship” university model in Russia: Searching for the third mission incentives. Tertiary Education and Management, 26(1), 77–90. https://doi.org/10.1007/s11233-019-09043-y
   Web of Science ®Google Scholar
• Farrell, M.J. (1957). The measurement of productive efficiency. Journal of the Royal Statistical Society Series A (General), 120(3), 253–281.
   Web of Science ®Google Scholar
• Flegg, A.T., Allen, D. O., Field, K., & Thurlow, T. W. (2004). Measuring the efficiency of British universities: A multi‐period data envelopment analysis. Education Economics, 12(3), 231–249. https://doi.org/10.1080/0904529042000258590
   Google Scholar
• Francesconi, M., Slonimczyk, F., & Yurko, A. (2019). Democratizing access to higher education in Russia: The consequences of the unified state exam reform. European Economic Review, 117, 56–82. https://doi.org/10.1016/j.euroecorev.2019.04.007
   Web of Science ®Google Scholar
• Froumin, I., Kouzminov, Y., & Semyonov, D. (2014). Institutional diversity in Russian higher education: Revolutions and evolution. European Journal of Higher Education, 4(3), 209–234. https://doi.org/10.1080/21568235.2014.916532
   Google Scholar
• Froumin, I., & Leshukov, O. (2015). National-regional relationships in federal higher education systems: The case of Russian federation. Higher Education Forum Hiroshima University, 12(1), 77–94.
   Google Scholar
• Hoxby, C.M. (2009). The changing selectivity of American colleges. Journal of Economic Perspectives, 23(4), 95–118. https://doi.org/10.1257/jep.23.4.95
   Web of Science ®Google Scholar
• Huisman, J. (2008). World-class universities. Higher Education Policy, 21(1), 1–4. https://doi.org/10.1057/palgrave.hep.8300180
   Google Scholar
• Johnes, J. (2006). Data envelopment analysis and its application to the measurement of efficiency in higher education. Economics of Education Review, 25(3), 273–288. https://doi.org/10.1016/j.econedurev.2005.02.005
   Web of Science ®Google Scholar
• Johnes, G., & Johnes, J. (1993). Measuring the research performance of UK economics departments: An application of data envelopment analysis. Oxford Economic Papers. 332–347.
   Google Scholar
• Johnes, J., & Johnes, G. (1995). Research funding and performance in UK university departments of economics: A frontier analysis. Economics of Education Review, 14(3), 301–314. https://doi.org/10.1016/0272-7757(95)00008-8
   Web of Science ®Google Scholar
• Jongbloed, B., & Vossensteyn, H. (2001). Keeping up performances: An international survey of performance-based funding in higher education. Journal of Higher Education Policy and Management, 23(2), 127–145. https://doi.org/10.1080/13600800120088625
   Google Scholar
• Kempkes, G., & Pohl, C. (2010). The efficiency of German universities–some evidence from nonparametric and parametric methods. Applied Economics, 42(16), 2063–2079. https://doi.org/10.1080/00036840701765361
   Web of Science ®Google Scholar
• Kounetas, K., Anastasiou, A., Mitropoulos, P., & Mitropoulos, I. (2011). Departmental efficiency differences within a Greek university: An application of a DEA and Tobit analysis. International Transactions in Operational Research, 18(5), 545–559. https://doi.org/10.1111/j.1475-3995.2011.00813.x
   Web of Science ®Google Scholar
• Li, Q., & Racine, J. S. (2007). Nonparametric econometrics: Theory and practice. Princeton University Press.
   Google Scholar
• Li, Q., & Racine, J. S. (2008). Nonparametric estimation of conditional CDF and quantile functions with mixed categorical and continuous data. Journal of Business & Economic Statistics, 26(4), 423–434.
   Web of Science ®Google Scholar
• Meeusen, W., & van Den Broeck, J. (1977). Efficiency estimation from Cobb-Douglas production functions with composed error. International Economic Review, 18(2), 435–444. https://doi.org/10.2307/2525757
   Web of Science ®Google Scholar
• Monk, D.H. (1989). The education production function: Its evolving role in policy analysis. Educational Evaluation and Policy Analysis, 11(1), 31–45. https://doi.org/10.3102/01623737011001031
   Google Scholar
• Parteka, A., & Wolszczak Derlacz, J. (2013). Dynamics of productivity in higher education: Cross-European evidence based on bootstrapped Malmquist indices. Journal of Productivity Analysis, 40(1), 67–82. https://doi.org/10.1007/s11123-012-0320-0
   Web of Science ®Google Scholar
• Platonova, D. (2019). The differential effect of state and market on the higher education landscape in Belarus and Russia: Soviet-type division and bifurcation. European Journal of Higher Education, 9(4), 412–432. https://doi.org/10.1080/21568235.2019.1643754
   Google Scholar
• Platonova, D., & Dmitry, S. (2018). Russia: The institutional landscape of Russian higher education. In J. Huisman, A. Smolentseva, & I. Froumin (Eds.), 25 years of transformations of higher education systems in post-soviet countries: Reform and continuity (pp. 337–362). Springer International Publishing.
   Google Scholar
• Racine, J. (1997). Consistent significance testing for nonparametric regression. Journal of Business & Economic Statistics, 15(3), 369–378. https://doi.org/10.1080/07350015.1997.10524714
   Web of Science ®Google Scholar
• Shavit, Y. (Ed.). (2007). Stratification in higher education: A comparative study. Stanford University Press.
   Google Scholar
• Simar, L., Lovell, C. K., & van den Eeckaut, P. (1994). Stochastic frontiers incorporating exogenous influences on efficiency. Discussion papers. 9403.
   Google Scholar
• Simar, L., & Wilson, P. W. (2007). Estimation and inference in two-stage, semi-parametric models of production processes. Journal of Econometrics, 136(1), 31–64. https://doi.org/10.1016/j.jeconom.2005.07.009
   Web of Science ®Google Scholar
• Smolentseva, A. (2015). Globalization and the research mission of universities in Russia. In M. Carnoy, I. Froumin, P. Loyalka, & J. Tilak (Eds.), Higher education in the BRICS countries (pp. 399–421). Springer.
   Google Scholar
• Sörlin, S. (2007). Funding diversity: Performance-based funding regimes as drivers of differentiation in higher education systems. Higher Education Policy, 20(4), 413–440. https://doi.org/10.1057/palgrave.hep.8300165
   Google Scholar
• Wolszczak Derlacz, J., & Parteka, A. (2011). Efficiency of European public higher education institutions: A two-stage multicountry approach. Scientometrics, 89(3), 887–917. https://doi.org/10.1007/s11192-011-0484-9
   PubMed Web of Science ®Google Scholar
• Zinchenko, D., & Egorov, A. (2019). Efficiency modeling of Russian universities. HSE Economic Journal, 23(1), 143–172. https://doi.org/10.17323/1813-8691-2019-23-1-143-172
   Google Scholar