Measuring university-based research in Europe: competing indicators and underlying assumptions

References

• Adler, R., Ewing, J., and Taylor, P., 2008. Citation statistics. Joint Committee on Quantitative Assessment of Research. Available from: www.mathunion.org/fileadmin/IMU/Report/CitationStatistics.pdf.
   Google Scholar
• Altbach, P., 2006. The dilemmas of ranking. International higher education, 42, 2–3.
   Google Scholar
• Austin, J.L., 1961. The meaning of a word. In J. L. Austin, eds. Philosophical papers. Oxford: Oxford University Press, 23–43.
   Google Scholar
• Ball, S.J., 1998. Performativity and fragmentation in ‘postmodern schooling’. In: J. Carter, ed. Postmodernity and fragmentation of welfare. London: Routledge, 187–203.
   Google Scholar
• Ball, S.J., 2012. Performativity, commodification and commitment: an I-Spy guide to the neoliberal university. British journal of educational studies, 60, 17–28. doi: 10.1080/00071005.2011.650940
   Web of Science ®Google Scholar
• Barnetson, B., and Cutright, M., 2000. Performance indicators as conceptual technologies. Higher education, 40 (3), 277–292. doi: 10.1023/A:1004066415147
   Web of Science ®Google Scholar
• Blalock, H.M., 1960. Social statistics. New York: Mc-Graw Ill.
   Google Scholar
• Brøgger, K., 2016. The rule of mimetic desire in higher education: governing through naming, shaming and faming. British journal of sociology of education, 37, 72–91. doi: 10.1080/01425692.2015.1096191
   Web of Science ®Google Scholar
• Bucharest Communiqué, 2012. Making the most of our potential: consolidating the european higher education area. http://www.ehea.info/.
   Google Scholar
• Campbell, D.T. (1969). Reforms as experiments. American psychologist, 24, 409–429. doi: 10.1037/h0027982
   Web of Science ®Google Scholar
• Cannavò, L., 1999. Teoria e pratica degli indicatori nella ricerca sociale. Milano: LED.
   Google Scholar
• Christensen, T., and Lægreid, P., eds., 2007. Transcending new public management: the transformation of public sector reforms. Aldershot: Ashgate.
   Google Scholar
• Clarke, M., 2012. The (absent) politics of neo-liberal education policy. Critical studies in education, 53 (3), 297–310. doi: 10.1080/17508487.2012.703139
   Web of Science ®Google Scholar
• Corbett, A., 2011. Ping pong: competing leadership for reform in EU higher education 1998-2006. European journal of education, 46, 36–53. doi: 10.1111/j.1465-3435.2010.01466.x
   Web of Science ®Google Scholar
• Daston, L., and Galison, P. (2007). Objectivity. New York: Zone Books.
   Google Scholar
• Dean, M., 2010. Governmentality. Power and rule in modern societies. 2nd ed. London: Sage.
   Google Scholar
• Desrosières, A., 2001. How ‘real' are statistics? four possible attitudes. Social research, 68, 339–355.
   Web of Science ®Google Scholar
• Desrosières, A., 2008. Pour une sociologie historique de la quantification. L’argument statistique, Vol. 1. Paris: Presses de l’Ecole des Mines de Paris.
   Google Scholar
• Desrosières, A., 2011. Buono o cattivo? Il ruolo del numero nel governo della città neoliberale. Rassegna Italiana di Sociologia, 3, 373–397.
   Google Scholar
• EC, 2009. Crest fourth OMC working group: ‘mutual learning on approaches to improve the excellence of research in universities. Luxembourg: Publications Office of the European Union.
   Google Scholar
• EC, 2012. A reinforced european research area partnership for excellence and growth. 392 final.
   Google Scholar
• EC, 2014. Research and innovation as sources of renewed growth. 339 final.
   Google Scholar
• ERA, 2015. Assessment of progress in achieving ERA in member states and associated countries. Final Report to DG Research and Innovation. London: ICF Consulting Services Limited.
   Google Scholar
• Espeland, W.N., and Stevens, M.L., 2008. A sociology of quantification. European journal of sociology, 49 (3), 401–436. doi: 10.1017/S0003975609000150
   Web of Science ®Google Scholar
• Estermann, T., Nokkala, T., and Steinel, M., 2011. University autonomy in Europe II. The scorecard. Brussels: European University Association.
   Google Scholar
• Eumida, 2010. Feasibility study for creating a European university data collection. Final study report. Brussels: European Commission.
   Google Scholar
• Fortin, J.M., and Currie, D.J., 2013. Big science vs. little science: how scientific impact scales with funding. Plos ONE, 8 (6), e65263. doi: 10.1371/journal.pone.0065263
   PubMed Web of Science ®Google Scholar
• Fullin, G., 2006. Strategie di reclutamento e diseguaglianze nel mercato del lavoro. Spunti di analisi a partire dall’Economia delle convenzioni. In: V. Borghi e T. Vitale, eds. A cura di, Le convenzioni del lavoro, il lavoro delle convenzioni. Milano: Franco Angeli, 263–274.
   Google Scholar
• Gambardella, D., and Lumino, R., 2015. Evaluative knowledge and policy making. beyond the intellectual virtue of téchne. Milano: Mc Graw Ill.
   Google Scholar
• Gornitzka, A., 2010. Bologna in context: a horizontal perspective on the dynamics of governance sites for a Europe of knowledge. European journal of education, 45 (4), 535–548. doi: 10.1111/j.1465-3435.2010.01452.x
   Web of Science ®Google Scholar
• Grek, S., 2010. International organisations and the shared construction of policy ‘problems’: problematisation and change in education governance in Europe. European educational research journal, 9 (3), 396–406. doi: 10.2304/eerj.2010.9.3.396
   Google Scholar
• Grek, S., and Ozga, J., 2008. Governing by numbers? Shaping education through data, CES Briefing No 44. Edinburgh: Centre for Educational Sociology.
   Google Scholar
• Gunter, H.M., Grimaldi, E., Hall, D., and Serpieri, R., eds., 2016. New public management and the reform of education. European lessons for policy and practice. London: Routledge.
   Google Scholar
• Hansen, H.F., 2010. Performance indicators used in performance-based research funding systems. In OECD, performance-based funding for public research in tertiary education institutions. workshop proceedings, OECD Publishing.
   Google Scholar
• Hicks, D., 2010. Overview of models of performance-based research funding systems. In OECD, performance-based funding for public research in tertiary education institutions. workshop proceedings, OECD Publishing.
   Google Scholar
• Hicks, D., 2012. Performance-based university research funding systems. Research policy, 41, 251–261. doi: 10.1016/j.respol.2011.09.007
   Web of Science ®Google Scholar
• Hood, C., 1991. A public management for all seasons? Public administration, 69, 3–19. doi: 10.1111/j.1467-9299.1991.tb00779.x
   Web of Science ®Google Scholar
• Hood, C., 1995. The “New public management” in the 1980s: variations on a theme. Accounting organizations and society, 20 (2/3), 93–109. doi: 10.1016/0361-3682(93)E0001-W
   Web of Science ®Google Scholar
• Juhl, H.J., Christensen, M., 2008. Quality management in a danish business school – a head of department perspective. Total quality management business excellence, 19 (7–8), 719–732. doi: 10.1080/14783360802159394
   Web of Science ®Google Scholar
• Kelling, R., 2006. The Bologna process and the Lisbon research agenda: the european commission’s expanding role in higher education discourse. European journal of education, 41 (2), 203–223. doi: 10.1111/j.1465-3435.2006.00256.x
   Google Scholar
• Krejsler, J.B., Olsson, U., and Petersson, K., 2012. Governing Europe by comparison, peer pressure & self-interest – On the Bologna stocktaking process as operator of national education policy. In The bulletin of the institute of technology and vocational education, Nagoya: Nagoya University, 35–47.
   Google Scholar
• Landri, P., 2014. Governing by standards: the fabrication of austerity in the Italian education system. Education inquiry, 5 (1), 25–41.
   Google Scholar
• Marginson, S., 1997. Markets in education. St. Leonards: Allen & Unwin.
   Google Scholar
• Marginson, S., and van der Wende, M., 2009. The new global landscape of nations and institutions. In OECD, Higher Education to 2030. Volume 2: Globalization. OECD Publishing.
   Google Scholar
• Miller, P., and Rose, N., 2008. Governing the present. Administering economic, social and personal life. Cambridge: Polity Press.
   Google Scholar
• Newman, J., and Clarke, J., 2009. Publics, politics and power. Remaking the public in public services. London: Sage.
   Google Scholar
• OECD, 2010. Performance-based funding for public research in tertiary education institutions. In Workshop Proceedings, OECD Publishing.
   Google Scholar
• Olssen, M., 2016. Neoliberal competition in higher education today: research, accountability and impact. British journal of sociology of education, 37 (1), 129–148. doi: 10.1080/01425692.2015.1100530
   Web of Science ®Google Scholar
• Olssen, M., and Peters, M.A., 2005. Neoliberalism, higher education and the knowledge economy: from the free market to knowledge capitalism. Journal of education policy, 20 (3), 313–345. doi: 10.1080/02680930500108718
   Web of Science ®Google Scholar
• Ozga, J., and Grek, S., 2012. Governing through learning. school self-evaluation as a knowledge-based regulatory tool. Recherches sociologiques et anthropologiques, 43-2, 35–52. doi: 10.4000/rsa.786
   Google Scholar
• Ranson, S., 2003. Public accountability in the age of neo-liberal governance. Journal of education policy, 18 (5), 459–480. doi: 10.1080/0268093032000124848
   Web of Science ®Google Scholar
• Rogers, P., 2008. Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation, 14 (1), 29–48. doi: 10.1177/1356389007084674
   Google Scholar
• Rose, N., 1991. Governing by numbers: figuring out democracy. Accounting, organizations and society, 16 (7), 673–692. doi: 10.1016/0361-3682(91)90019-B
   Google Scholar
• Rossi, P.H., Freeman, H.E., and Lipsey, M.H., 1999. Evaluation. A systematic approach. Thousand Oaks: Sage.
   Google Scholar
• Salais, R., 2010. Usages et Mésusages de L’argument Statistique: Le Pilotage des Politiques Publiques par la Performance. Revue française des affaires sociales, 1 (1-2), 129–147.
   Google Scholar
• Sanderson, I., 2000. Evaluation in complex policy systems. Evaluation, 6 (4), 433–454. doi: 10.1177/13563890022209415
   Google Scholar
• Timmersman, S., and Berg, M., 2003. The gold standard. The challenge of evidence-based medicine and standardization in health care. Philadelphia: Temple University Press.
   Google Scholar