A critical review of the proposed academic performance indicators for the assessment of individual researchers in Hungary

References

• Abramo, G., Cicero, T. and D’Angelo, C.A. (2013), “Individual research performance: A proposal for comparing apples to oranges”, Journal of Informetrics, Vol. 7 No. 2, pp. 528–539. doi: 10.1016/j.joi.2013.01.013
   Web of Science ®Google Scholar
• Bennett, D.M. and Taylor, D.McD. (2003), “Unethical practices in authorship of scientific papers”, Emergency Medicine, Vol. 15 No. 3, pp. 263−270. doi: 10.1046/j.1442-2026.2003.00432.x
   PubMedGoogle Scholar
• Biscaro, C. and Giupponi, C. (2014), “Co-authorship and bibliographic coupling network effects on citations”, PLoS One, Vol. 9 No. 6, e99502 doi: 10.1371/journal.pone.0099502
   PubMedGoogle Scholar
• Bloch, C. and Schneider, J.W. (2016), “Performance-based funding models and researcher behavior: An analysis of the influence of the Norwegian Publication Indicator at the individual level”, Research Evaluation, Vol. 25 No. 4, pp. 371−382.
   Web of Science ®Google Scholar
• Bornmann, L. and Marx, W. (2014), “How to evaluate individual researchers working in the natural and life sciences meaningfully? A proposal of methods based on percentiles of citations”, Scientometrics, Vol. 98 No. 1, 487−509. doi: 10.1007/s11192-013-1161-y
   Web of Science ®Google Scholar
• Bornmann, L. (2017), “Measuring impact in research evaluations: a thorough discussion of methods for, effects of and problems with impact measurements”, Higher Education, Vol. 73 No. 5, 775−787. doi: 10.1007/s10734-016-9995-x
   Web of Science ®Google Scholar
• Bosquet, C. and Combes, P.P. (2013), “Are academics who publish more also more cited? Individual determinants of publication and citation records”, Scientometrics, Vol. 97 No. 3, 831–857. doi: 10.1007/s11192-013-0996-6
   Web of Science ®Google Scholar
• Bouyssou, D. and Marchant, T. (2016), “Ranking authors using fractional counting of citations: An axiomatic approach”, Journal of Informetrics, Vol. 10 No. 1, 183−199. doi: 10.1016/j.joi.2015.12.006
   Google Scholar
• Brito, R. and Rodríguez-Navarro, A. (2019), “Evaluating research and researchers by the journal impact factor: Is it better than coin flipping?”, Journal of Informetrics, Vol. 13 No. 1, 314−324. doi: 10.1016/j.joi.2019.01.009
   Google Scholar
• Cagan, R. (2013), “The San Francisco Declaration on Research Assessment” DMM Disease Models and Mechanisms, Vol. 6 No. 4, 869−870.
   PubMed Web of Science ®Google Scholar
• Castelvecchi, D. (2015), “Physics paper sets record with more than 5,000 authors”, Nature News, 15 May 2015
   Google Scholar
• Cole, J.R. and Cole, S. (1974), “Social stratification in science”, American Journal of Physics, Vol. 42 No. 10, 923–924. doi: 10.1119/1.1987897
   Google Scholar
• Coomes, O.T., Moore, T., Paterson, J., Breau, S., Ross, N.A. and Roulet, N. (2013), “Academic Performance Indicators for Departments of Geography in the United States and Canada”, Professional Geographer, Vol. 65 No. 3, 433−450. doi: 10.1080/00330124.2012.697798
   Web of Science ®Google Scholar
• Cronin, B. (2001), “Hyperauthorship: A postmodern perversion or evidence of a structural shift in scholarly communication practices?”, Journal of the American Society for Information Science and Technology, Vol. 52 No. 7, 558−569. doi: 10.1002/asi.1097
   Web of Science ®Google Scholar
• Csomós, G. (2020), “Introducing recalibrated academic performance indicators in the evaluation of individuals’ research performance: A case study from Eastern Europe”, Journal of Informetrics, Vol. 14 No. 4, 101073 doi: 10.1016/j.joi.2020.101073
   Google Scholar
• de Mesnard, L. (2017), “Attributing credit to coauthors in academic publishing: The 1/n rule, parallelization, and team bonuses”, European Journal of Operational Research, Vol. 260 No. 2, 778−788. doi: 10.1016/j.ejor.2017.01.009
   Web of Science ®Google Scholar
• De Rijcke, S., Wouters, P.F., Rushforth, A.D., Franssen, T.P. and Hammarfelt, B. (2016), “Evaluation practices and effects of indicator use-a literature review”, Research Evaluation, Vol. 25 No. 2, 161−169. doi: 10.1093/reseval/rvv038
   Web of Science ®Google Scholar
• Egghe, L., Rousseau, R. and Van Hooydonk, G. (2000), “Methods for accrediting publications to authors or countries: Consequences for evaluation studies”, Journal of the American Society for Information Science and Technology, Vol. 51 No. 2, 145−157. doi: 10.1002/(SICI)1097-4571(2000)51:2<145::AID-ASI6>3.0.CO;2-9
   Google Scholar
• Ferligoj, A., Kronegger, L., Mali, F., Snijders, T.A.B. and Doreian, P. (2015), “Scientific collaboration dynamics in a national scientific system”, Scientometrics, Vol. 104 No. 3, 985−1012. doi: 10.1007/s11192-015-1585-7
   PubMed Web of Science ®Google Scholar
• Gauffriau, M., Larsen, P.O., Maye, I., Roulin-Perriard, A. and Von Ins, M. (2008), “Comparisons of results of publication counting using different methods”, Scientometrics, Vol. 77 No. 1, 147−176. doi: 10.1007/s11192-007-1934-2
   Web of Science ®Google Scholar
• Gauffriau, M. (2017), “A categorization of arguments for counting methods for publication and citation indicators”, Journal of Informetrics, Vol. 11 No. 3, 672−684. doi: 10.1016/j.joi.2017.05.009
   Google Scholar
• Gavel, Y. and Iselid, L. (2008), “Web of Science and Scopus: A journal title overlap study”, Online Information Review, Vol. 32 No. 1, 8−21. doi: 10.1108/14684520810865958
   Web of Science ®Google Scholar
• Hagen, N.T. (2000), “Harmonic publication and citation counting: Sharing authorship credit equitably - not equally, geometrically or arithmetically”, Scientometrics, Vol. 84 No. 3, 785−793. doi: 10.1007/s11192-009-0129-4
   Google Scholar
• Hagen, N.T. (2014), “Counting and comparing publication output with and without equalizing and inflationary bias”, Journal of Informetrics, Vol. 8 No. 2, 310−317. doi: 10.1016/j.joi.2014.01.003
   Web of Science ®Google Scholar
• Henriksen, D. (2016), “The rise in co-authorship in the social sciences (1980–2013)”, Scientometrics, Vol. 107 No. 2, 455−476. doi: 10.1007/s11192-016-1849-x
   Web of Science ®Google Scholar
• He, Z.-L., Geng, X.-S. and Campbell-Hunt, C. (2009), “Research collaboration and research output: A longitudinal study of 65 biomedical scientists in a New Zealand university”, Research Policy, Vol. 38 No. 2, 306−317. doi: 10.1016/j.respol.2008.11.011
   Web of Science ®Google Scholar
• Herz, N., Dan, O., Censor, N. and Bar-Haim, Y. (2020), “Authors overestimate their contribution to scientific work, demonstrating a strong bias”, Proceedings of the National Academy of Sciences of the United States of America, Vol. 117 No. 12, 6282−6285. doi: 10.1073/pnas.2003500117
   PubMed Web of Science ®Google Scholar
• Hicks, D., Wouters, P., Waltman, L., De Rijcke, S. and Rafols, I. (2015), “Bibliometrics: The Leiden Manifesto for research metrics”, Nature, Vol. 520 No. 7548, 429−431. doi: 10.1038/520429a
   PubMed Web of Science ®Google Scholar
• Katz, J.S. and Martin, B.R. (1997), “What is research collaboration?”, Research Policy, Vol. 26 No. 1, 1−18. doi: 10.1016/S0048-7333(96)00917-1
   Web of Science ®Google Scholar
• Kosmulski, M. (2012), “The order in the lists of authors in multi-author papers revisited”, Journal of Informetrics, Vol. 6 No. 4, 639−644. doi: 10.1016/j.joi.2012.06.006
   Web of Science ®Google Scholar
• Lange, L.L. (2001), “Citation counts of multi-authored papers – First-named authors and further authors”, Scientometrics, Vol. 52 No. 3, 457−470. doi: 10.1023/A:1014299917063
   Web of Science ®Google Scholar
• Lee, S. and Bozeman, B. (2005), “The impact of research collaboration on scientific productivity”, Social Studies of Science, Vol. 35 No. 5, 673−702. doi: 10.1177/0306312705052359
   Web of Science ®Google Scholar
• Lindsey, D. (1980), “Production and Citation Measures in the Sociology of Science: The Problem of Multiple Authorship”, Social Studies of Science, Vol. 10 No. 2, 145−162. doi: 10.1177/030631278001000202
   Web of Science ®Google Scholar
• McKiernan, E.C., Schimanski, L.A., Nieves, C.M., Matthias, L., Niles, M.T. and Alperin, J.P. (2019), “Use of the journal impact factor in academic review, promotion, and tenure evaluations”, eLife, Vol. 8, e47338 doi: 10.7554/eLife.47338
   PubMed Web of Science ®Google Scholar
• Mongeon, P. and Paul-Hus, A. (2016), “The journal coverage of Web of Science and Scopus: a comparative analysis”, Scientometrics, Vol. 106 No. 1, 213−228. doi: 10.1007/s11192-015-1765-5
   Web of Science ®Google Scholar
• Mutz, R. and Daniel, H.-D. (2019), “How to consider fractional counting and field normalization in the statistical modeling of bibliometric data: A multilevel Poisson regression approach”, Journal of Informetrics, Vol. 13 No. 2, 643−657. doi: 10.1016/j.joi.2019.03.007
   Google Scholar
• Osório, A. (2018), “On the impossibility of a perfect counting method to allocate the credits of multi-authored publications”, Scientometrics, Vol. 116 No. 3, 2161−2173. doi: 10.1007/s11192-018-2815-6
   Web of Science ®Google Scholar
• Ossenblok, T.L.B., Verleysen, F.T. and Engels, T.C.E. (2014), “Coauthorship of journal articles and book chapters in the social sciences and humanities (2000-2010)”, Journal of the Association for Information Science and Technology, Vol. 65 No. 5, 882−897. doi: 10.1002/asi.23015
   Google Scholar
• Pajić, D. (2015), “Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?”, Scientometrics, Vol. 102 No. 3, 2131−2150. doi: 10.1007/s11192-014-1510-5
   Google Scholar
• Perianes-Rodriguez, A., Waltman, L. and van Eck, N.J. (2016), “Constructing bibliometric networks: A comparison between full and fractional counting”, Journal of Informetrics, Vol. 10 No. 4, 1178−1195. doi: 10.1016/j.joi.2016.10.006
   Web of Science ®Google Scholar
• Price, D. (1981), “Multiple authorship”, Science, Vol. 212 No. 4498, 986. doi: 10.1126/science.212.4498.986.b
   Google Scholar
• Rousseau, R. (1992), “Breakdown of the robustness property of Lotka’s Law: The case of adjusted counts for multiauthorship attribution”, Journal of the American Society for Information Science, Vol. 43 No. 10, 645−647. doi: 10.1002/(SICI)1097-4571(199212)43:10<645::AID-ASI1>3.0.CO;2-X
   Google Scholar
• Sahel, J.-A. (2011), “Quality versus quantity: Assessing individual research performance”, Science Translational Medicine, Vol. 3 No. 84, 84cm13 doi: 10.1126/scitranslmed.3002249
   PubMed Web of Science ®Google Scholar
• Stallings, J., Vance, E., Yang, J., Vannier, M.W., Liang, J., Pang, L., Dai, L., Ye, I. and Wang, G. (2013), “Determining scientific impact using a collaboration index”, Proceedings of the National Academy of Sciences of the United States of America, Vol. 110 No. 24, 9680−9685. doi: 10.1073/pnas.1220184110
   PubMed Web of Science ®Google Scholar
• Stockemer, D. and Wigginton, M.J. (2019). “Publishing in English or another language: An inclusive study of scholar’s language publication preferences in the natural, social and interdisciplinary sciences”, Scientometrics, Vol. 118, 645–652. doi: 10.1007/s11192-018-2987-0
   Web of Science ®Google Scholar
• Tahamtan, I., Safipour Afshar, A. and Ahamdzadeh, K. (2016), “Factors affecting number of citations: a comprehensive review of the literature”, Scientometrics, Vol. 107 No. 3, 1195−1225. doi: 10.1007/s11192-016-1889-2
   Web of Science ®Google Scholar
• Trenchard, P.M.: Hierarchical bibliometry (1992), “A new objective measure of individual scientific performance to replace publication counts and to complement citation measures”, Journal of Information Science, Vol. 18 No. 1, 69−75. doi: 10.1177/016555159201800108
   Google Scholar
• Trinkle, B.S., Phillips, T., Hall, A. and Moffatt, B. (2017), “Neutralising fair credit: Factors that influence unethical authorship practices”, Journal of Medical Ethics, Vol. 43 No. 6, 368−373. doi: 10.1136/medethics-2015-103365
   PubMed Web of Science ®Google Scholar
• Trueba, F.J. and Guerrero, H. (2004), “A robust formula to credit authors for their publications”, Scientometrics, Vol. 60 No. 2, 181−204. doi: 10.1023/B:SCIE.0000027792.09362.3f
   Web of Science ®Google Scholar
• Van Hooydonk, G. (1997), “Fractional counting of multiauthored publications: Consequences for the impact of authors”, Journal of the American Society for Information Science, Vol. 48 No. 10, 944−945. doi: 10.1002/(SICI)1097-4571(199710)48:10<944::AID-ASI8>3.0.CO;2-1
   Web of Science ®Google Scholar
• Vavryčuk, V. (2018), “Fair ranking of researchers and research teams”, PLoS One, Vol. 13 No. 4, e0195509 doi: 10.1371/journal.pone.0195509
   PubMedGoogle Scholar
• Vieira, E.S. and Gomes, J.A.N.F. (2010), “Citations to scientific articles: Its distribution and dependence on the article features”, Journal of Informetrics, Vol. 4 No. 1, 1–13. doi: 10.1016/j.joi.2009.06.002
   Web of Science ®Google Scholar
• Waltman, L. and van Eck, N.J. (2015), “Field-normalized citation impact indicators and the choice of an appropriate counting method”, Journal of Informetrics, Vol. 9 No. 4, 872−894. doi: 10.1016/j.joi.2015.08.001
   Web of Science ®Google Scholar
• Zhang, C.-T. (2009), “A proposal for calculating weighted citations based on author rank”, EMBO Reports, Vol. 10 No. 5, 416−417. doi: 10.1038/embor.2009.74
   PubMed Web of Science ®Google Scholar
• Zhang, L., Rousseau, R. and Sivertsen, G. (2017), “Science deserves to be judged by its contents, not by its wrapping: Revisiting Seglen’s work on journal impact and research evaluation”, PLoS One, Vol. 12 No. 3, e0174205 doi: 10.1371/journal.pone.0174205
   PubMed Web of Science ®Google Scholar
• Zhou, P., Thijs, B. and Glänzel, W. (2009), “Is China also becoming a giant in social sciences?”, Scientometrics, Vol. 79 No. 3, 593–621. doi: 10.1007/s11192-007-2068-x
   Web of Science ®Google Scholar
• Zhou, P. and Leydesdorff, L. (2011), “Fractional counting of citations in research evaluation: A cross- and interdisciplinary assessment of the Tsinghua University in Beijing”, Journal of Informetrics, Vol. 5 No. 3, 360–368. doi: 10.1016/j.joi.2011.01.010
   Google Scholar