An evaluation of metrics used by the Performance-based Research Fund process in New Zealand

References

• Aitchison J. A., & Brown J. A. C. (1957). The lognormal distribution with special reference to its uses in economics. Cambridge: Cambridge University Press.
   Google Scholar
• Allison P. D., & Stewart J. A. (1974). Productivity differences among scientists: Evidence for accumulative advantage. American Sociological Review, 39, 596–606. doi: 10.2307/2094424
   Web of Science ®Google Scholar
• Anderson D. L., Smart W., & Tressler J. (2013). Evaluating research – peer review team assessment and journal based bibliographic measures: New Zealand PBRF research output scores in 2006. New Zealand Economic Papers, 47, 140–157. doi: 10.1080/00779954.2013.772879
   Google Scholar
• Anderson D. A., & Tressler J. (2014). The New Zealand performance-based research fund and its impact on publication activity in Economics. Research Evaluation, 23, 1–11. doi: 10.1093/reseval/rvt017
   Web of Science ®Google Scholar
• Buckle R. A., & Creedy J. (2018a). The evolution of research quality in New Zealand Universities as measured by the Performance-Based Research Fund process. New Zealand Economic Papers, forthcoming.
   Google Scholar
• Buckle R. A., & Creedy J. (2018b). The impact on research quality of performance-based funding: The case of New Zealand's PBRF scheme. Agenda, 25, 25–48.
   Web of Science ®Google Scholar
• Cortés L. M., Perote J., & Andrés M.-V. (2016). The productivity of top researchers: A semi-nonparametric approach. Universidad EAFIT, Centro de Investigacion Economicas y Financieras Documentos de trabajo (Working Paper no. 16-05).
   Google Scholar
• de Boer H., Jongbloed B., Benneworth P., Cremonini L., Kolster R., Kottmann A., Lemmens-Krug K., & Vossenstey H. (2015). Performance-based funding and performance agreements in fourteen higher education systems, Report for the Ministry of Education, Culture and Science, Centre for Higher Education Policy Studies, C15HdB014, Universiteit Twente, Enschede. Retrieved from www.utwente.nl/cheps
   Google Scholar
• Gibson J., Anderson D. L., & Tressler J. (2008). Do research assessment exercises raise the returns to publication quality? Evidence from the New Zealand market for academic economists. Department of Economics, University of Waikato (Working Paper No. 08/11).
   Google Scholar
• Heckman J. J., & Sattinger M. (1991). Introduction to the distribution of earnings and of individual output, by A.D. Roy. Economic Journal, 125, 378–385. doi: 10.1111/ecoj.12226
   Web of Science ®Google Scholar
• Hicks D., & Katz J. S. (2011). Equity and excellence in research funding. Minerva, 49, 137–151. doi: 10.1007/s11024-011-9170-6
   Web of Science ®Google Scholar
• Ministry of Education (2012). A history and overview of the PBRF. Wellington: Ministry of Education. Retrieved from https://education.govt.nz/assets/Documents/Further-education/Policies-and-strategies/Performance-based-research-fund/PBRFHistoryAndOverview.pdf
   Google Scholar
• Hodder A. P. W., & Hodder C. (2010). Research culture and New Zealand's performance-based research fund: some insights from bibliographic compilations of research outputs. Scientometrics, 84, 887–901. doi: 10.1007/s11192-010-0201-0
   Web of Science ®Google Scholar
• Ministry of Education (2013). An international comparison of performance-based research funding schemes. Retrieved from http://www.minedu.govt.nz/NZEducation/EducationPolicies/TertiaryEducation/PolicyandStrategy/~/media/MinEdu/Files/EducationSectors/TertairyEducation/PBRF/InternationalComparison.pdf
   Google Scholar
• New Zealand Tertiary Education Commission (2002). Investing in excellence: The report of the performance-based research fund working group. Wellington: Ministry of Education and Transition Tertiary Education Commission.
   Google Scholar
• Moreira J. A. G., Zeng X. H. T., & Amaral L. A. N. (2015). The distribution of the asymptotic number of citations to sets of publications by a researcher or from an academic department are consistent with a discrete lognormal model. PloS One, 10(11), e0143108. doi: 10.1371/journal.pone.0143108
   PubMed Web of Science ®Google Scholar
• Perc M. (2010). Zipf's law and log-normal distributions in measures of scientific output across fields and institutions: 40 years of Slovenia's research as an example. Journal of Informetrics, 4, 358–364. doi: 10.1016/j.joi.2010.03.001
   Web of Science ®Google Scholar
• OECD (2010). Performance-based funding for public research in tertiary education institutions: Workshop proceedings. OECD Publishing. Retrieved from http://www.oecdilibrary.org/education/performance-based-funding-for-public-research-intertiary-education-institutions_9789264094611-en.
   Google Scholar
• New Zealand Tertiary Education Commission (2013). Performance-based research fund: Evaluating research excellence – the 2012 assessment. Wellington: Tertiary Education Commission.
   Google Scholar
• Roy A. D. (1950). The distribution of earnings and of individual output. Economic Journal, 60, 489–505. doi: 10.2307/2226792
   Web of Science ®Google Scholar
• Ruocco G., Daraio C., Folli V., & Leonetti M (2017). Bibliometric indicators: The origin of their log-normal distribution and why they are not a reliable proxy for an individual scholar's talent. Palgrave Communications. doi: 10.1057/palcomms.2017.64
   PubMed Web of Science ®Google Scholar
• Shockley W. (1957). On the statistics of individual variations of productivity in research laboratories. Proceedings of the Institute of Radio Engineers, 45, 279–290.
   Google Scholar
• Smart W. (2009). The impact of the performance-based research fund on the research productivity of New Zealand universities. Wellington: Ministry of Education. Retrieved from www.educationcounts.govt.nz
   Google Scholar
• Swan J. E., Powers T. L., & Bos T. (1999). The concentration of career research productivity among marketing academicians: Implications for faculty evaluation. Marketing Education Review, 9, 39–50. doi: 10.1080/10528008.1999.11488659
   Google Scholar
• Wilsdon J., Allen L., Belfiore E., Campbell P., Curry S., Hill S., … Johnson B. (2015). The metric tide: Report of the independent review of the role of metrics in research assessment and management. doi: 10.13140/RG.2.1.4929.1363
   Google Scholar