Is it necessary to evaluate university research performance instrument? Evidence from Indonesia

References

• Abramo, G., & D’Angelo, C. A. (2014). How do you define and measure research productivity? Scientometrics, 101(2), 1129–19. https://doi.org/10.1007/s11192-014-1269-8
   Web of Science ®Google Scholar
• Abramo, G., & D’Angelo, C. A. (2015). Evaluating university research: Same performance indicator, different rankings. Journal of Informetrics, 9(3), 514–525. https://doi.org/10.1016/j.joi.2015.04.002
   Web of Science ®Google Scholar
• Abramo, G., D’Angelo, C. A., & Di Costa, F. (2014). Variability of research performance across disciplines within universities in non-competitive higher education systems. Scientometrics, 98(2), 777–795. https://doi.org/10.1007/s11192-013-1088-3
   Web of Science ®Google Scholar
• Aggarwal, A., Sundar, G., & Thakur, M. (2013). Techniques of performance appraisal - A review. International Journal of Engineering and Advanced Technology, 2(3), 2249–8958. http://www/ijeat.org/wp-content/uploads/papers/v2i3/C1188022313.pdf
   Google Scholar
• Ahmad, A. R., Soon, N. K., & Ting, N. P. (2015). Income generation activities among academic staffs at Malaysian public universities. International Education Studies, 8(6), 194–203. https://doi.org/10.5539/ies.v8n6p194
   Google Scholar
• Aldieri, Luigi., Guida, Gennaro., Kotsemir, Maxim., & Vinci, Cincetto Paolo. (2019). In Quality and quantity (Vol. 53, Issue 4). 2003–2040. https://doi.org/10.1007/s11135-019-00853-1
   Google Scholar
• Alstete, J. W. (2014). Revenue generation strategies: Leveraging higher education resources for increased income. ASHE Higher Education Report, 41(1), 1–138. https://doi.org/10.1002/aehe.20019
   Google Scholar
• Armstrong, M. (1994). Armstrong’s handbook of performance management: An evidence-based guide to delivering high performance (Google eBook) (4th ed.). Kogan Page. http://books.google.com/books?id=wtwS9VG-p4IC&pgis=1
   Google Scholar
• Avanesova, A. A., & Shamliyan, T. A. (2018). Comparative trends in research performance of the Russian universities. Scientometrics, 116(3), 2019–2052. https://doi.org/10.1007/s11192-018-2807-6
   Web of Science ®Google Scholar
• Azma, F. (2010). Qualitative Indicators for the evaluation of universities performance. Procedia - Social and Behavioral Sciences, 2(2), 5408–5411. https://doi.org/10.1016/j.sbspro.2010.03.882
   Google Scholar
• Balabonienė, I., & Večerskienė, G. (2014). The peculiarities of performance measurement in universities. Procedia - Social and Behavioral Sciences, 156(April), 605–611. https://doi.org/10.1016/j.sbspro.2014.11.249
   Google Scholar
• Ball, R., & Wilkinson, R. (1994). The use and abuse of performance indicators in UK higher education. Higher Education, 27(4), 417–427. https://doi.org/10.1007/BF01384902
   Web of Science ®Google Scholar
• Bonaccorsi, A., & Secondi, L. (2017). The determinants of research performance in European universities: A large scale multilevel analysis. Scientometrics, 112(3), 1147–1178. https://doi.org/10.1007/s11192-017-2442-7
   Web of Science ®Google Scholar
• Bosch, A., & Taylor, J. (2011). A proposed framework of institutional research development phases. Journal of Higher Education Policy and Management, 33(5), 443–457. https://doi.org/10.1080/1360080X.2011.585742
   Google Scholar
• Brown, M. G., & Svenson, R. A. (1988). Measuring R and D productivity. Research-Technology Management, 31(4), 11–15. https://doi.org/10.1080/08956308.1988.11670531
   Web of Science ®Google Scholar
• Çakır, M. P., Acartürk, C., Alaşehir, O., & Çilingir, C. (2015). A comparative analysis of global and National University ranking systems. Scientometrics, 103(3), 813–848. https://doi.org/10.1007/s11192-015-1586-6
   Web of Science ®Google Scholar
• Chigudu, D., & Toerien, D. F. (2018). Strength in diversity: An opportunity for Africa’s development. Cogent Social Sciences, 4(1), 1–15. https://doi.org/10.1080/23311886.2018.1558715
   PubMed Web of Science ®Google Scholar
• Cooper, D. R., & Schindler, P. S. (2014). Business research methods (12th ed.). Sage.
   Google Scholar
• Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). sage.
   Google Scholar
• D’Abate, C., Youndt, M., & Wenzel, K. (2009). Making the most of an internship: An empirical study of internship satisfaction. Academy of Management Learning and Education, 8(4), 527–539. https://doi.org/10.5465/AMLE.2009.47785471
   Web of Science ®Google Scholar
• Diem, A., & Wolter, S. C. (2013). The use of bibliometrics to measure research performance in education sciences. Research in Higher Education, 54(1), 86–114. https://doi.org/10.1007/s11162-012-9264-5
   Web of Science ®Google Scholar
• Diezmann, C. M. (2018). Understanding research strategies to improve ERA performance in Australian universities: Circumventing secrecy to achieve success. Journal of Higher Education Policy and Management, 40(2), 154–174. https://doi.org/10.1080/1360080X.2018.1428411
   Web of Science ®Google Scholar
• Dikbud. (2013). University research performance guideline. Ministry of Education and Culture. http://simlitabmas.ristekdikti.go.id/unduh_berkas/Panduan_Operator_Kinerja_Kelembagaan_Penelitian_2017.pdf
   Google Scholar
• Dikbud. (2020). PD DIKTI. https://pddikti.kemdikbud.go.id
   Google Scholar
• Dikti. (2020). Guideline for Merdeka Belajar Kampus Merdeka (1st ed.). Directorate General for Higher Education.
   Google Scholar
• Dill, D. D., & Soo, M. (2005). Academic quality, league tables, and public policy: A cross-national analysis of university ranking systems. Higher Education, 49(4), 495–533. https://doi.org/10.1007/s10734-004-1746-8
   Web of Science ®Google Scholar
• Dixon, R., & Hood, C. (2016). Ranking academic research performance: A recipe for success? Sociologie Du Travail, 58(4), 403–411. http://doi.org/10.1016/j.soctra.2016.09.020
   Web of Science ®Google Scholar
• Dundar, H., & Lewis, D. R. (1998). Determinants of research productivity in higher education. Research in Higher Education, 43(3), 309–329. https://doi.org/10.1007/BF02457402
   Google Scholar
• Eduan, W., & Yuanqun, J. (2019). Patterns of the China-Africa research collaborations from 2006 to 2016: A bibliometric analysis. Higher Education, 77(6), 979–994. https://doi.org/10.1007/s10734-018-0314-6
   Web of Science ®Google Scholar
• Favero, N., & Rutherford, A. (2019). Will the tide lift all boats? Examining the equity effects of performance funding policies in U.S. Higher Education. Research in Higher Education, 61(1), 1–25. https://doi.org/10.1007/s11162-019-09551-1
   Web of Science ®Google Scholar
• Feranecová, A., & Krigovská, A. (2016). Measuring the performance of universities through cluster analysis and the use of financial ratio indexes. Economics and Sociology, 9(4), 259–271. https://doi.org/10.14254/2071-789X.2016/9-4/16
   Google Scholar
• Hannover Research. (2020). Alternative revenue generation strategies. Higher Education, June. https://insights.hanoverresearch.com/hubfs/Alternative-Revenue-Generation-Strategies.pdf
   Google Scholar
• Hazelkorn, E. (2008). Learning to live with league tables and ranking: The experience of institutional leaders. Higher Education Policy, 21(2), 193–215. https://doi.org/10.1057/hep.2008.1
   Google Scholar
• Hermanu, A. I., Sondari, M. C., Dimyati, M., & Sari, D. (2022). Study on university research performance based on systems theory: systematic literature review. International Journal of Productivity and Quality Management, 35(4), 447–472. https://doi.org/10.1504/IJPQM.2022.122777
   Google Scholar
• Hill, S. (1995). Regional empowerment in the new global science and technology order. Asian Studies Review, 18(3), 2–17. https://doi.org/10.1080/03147539508713014
   Google Scholar
• Jafari, M., Bourouni, A., & Amiri, R. H. (2009). A new framework for selection of the best performance appraisal method. European Journal of Social Sciences, 7(3), 92–100.
   Google Scholar
• Javed, Y., Ahmad, S., & Khahro, S. H. (2020). Evaluating the research performance of Islamabad-based higher education institutes. SAGE Open, 10(1), 215824402090208. https://doi.org/10.1177/2158244020902085
   Web of Science ®Google Scholar
• Kamble, R., & Wankhade, L. (2017). Perspectives on productivity: Identifying attributes influencing productivity in various industrial sectors. International Journal of Productivity and Quality Management, 22(4), 536–566. https://doi.org/10.1504/IJPQM.2017.087868
   Google Scholar
• Kaplan, R. S., & Norton, D. P. (1992). The balanced scorecard – measures that drive performance. Harvard Business Review, 70(1), 71–79.
   PubMed Web of Science ®Google Scholar
• Karpińska, A. (2020). Innovation and science dilemmas. Unintended consequences of innovation policy for science. Polish Experience. Cogent Social Sciences, 6(1), 1–19. https://doi.org/10.1080/23311886.2020.1718055
   Web of Science ®Google Scholar
• Kim, D.-Y., Kumar, V., & Murphy, S. A. (2008). European foundation for quality management (fEFQM) business excellence model: A literature review and future research agenda. Asac, 1, 1–48. http://ojs.acadiau.ca/index.php/ASAC/article/view/839/728
   Google Scholar
• Kobarg, S., Stumpf-Wollersheim, J., & Welpe, I. M. (2017). University-industry collaborations and product innovation performance: The moderating effects of absorptive capacity and innovation competencies. Journal of Technology Transfer, 43(6), 1696–1724. http://doi.org/10.1007/s10961-017-9583-y
   Web of Science ®Google Scholar
• Layzell, D. T. (1999). Research in Higher Education, Volume 40, Number 2 - SpringerLink. Research in Higher Education, 40(2), 233–246. https://doi.org/10.1023/A:1018790815103
   Web of Science ®Google Scholar
• LPDP. (2018). Director Act 25/LPDP/2018, Guideline for Rispro. https://www.lpdp.kemenkeu.go.id/api/Medias/b24d8d97-1633-4abf-9a28-e5fbce3724ba
   Google Scholar
• Macdonald, S., & Headlam, N. (2008). Manchester: Express Network. 72. https://www.ccardesa.org/knowledge-products/research-methods-handbook-introductory-guide-research-methods-social-research
   Google Scholar
• Madl, L., Radebner, T., & Stouffs, R. (2021). Technology transfer for social benefit: Ten principles to guide the process. Cogent Social Sciences, 7(1), 1–19. https://doi.org/10.1080/23311886.2021.1947560
   Web of Science ®Google Scholar
• Marisha, B., K, S., & Singh, V. K. (2017). Research performance of central universities in India. Current Science, 112(11), 2198–2207. https://doi.org/10.18520/cs/v112/i11/2198-2207
   Web of Science ®Google Scholar
• Meek, V. L., Der Lee, V., & Jeannet, J.(2005). University of New England 2. Performance indicators for assessing and benchmarking research capacities in universities. Unesco Bangkok Occasional Paper (Issue 2). https://minerva-access.unimelb.edu.au/bitstream/handle/11343/28907/264616_2005PerformanceIndicators.pdf?sequence=1&isAllowed=y
   Google Scholar
• Meng, X., & Minogue, M. (2011). Performance measurement models in facility management: A comparative study. Facilities, 29(11), 472–484. https://doi.org/10.1108/02632771111157141
   Google Scholar
• Morgenbesser, L., & Weiss, M. L. (2018). Survive and Thrive: Field research in Authoritarian Southeast Asia. Asian Studies Review, 42(3), 385–403. https://doi.org/10.1080/10357823.2018.1472210
   Web of Science ®Google Scholar
• Okamuro, H., & Nishimura, J. (2012). Impact of university intellectual property policy on the performance of university-industry research collaboration. Journal of Technology Transfer, 38(3), 273–301. doi:10.1007/s10961-012-9253-z
   Web of Science ®Google Scholar
• Parti, K., Szigeti, A., & Serpa, S. (2021). The future of interdisciplinary research in the digital era: Obstacles and perspectives of collaboration in social and data sciences - An empirical study. Cogent Social Sciences, 7(1), 1–15. https://doi.org/10.1080/23311886.2021.1970880
   Web of Science ®Google Scholar
• Prathap, G. (2016). Mapping excellence and diversity of research performance in India. Current Science, 111(3), 470–474. https://doi.org/10.18520/cs/v111/i3/470-474
   Web of Science ®Google Scholar
• Ramsden, P. (1999). Predicting institutional research performance from published indicators: A test of a classification of Australian university types. Higher Education, 37(4), 341–358. https://doi.org/10.1023/A:1003692220956
   Web of Science ®Google Scholar
• Reichert, S. (2019). the Role of Universty in Regional Innovation Ecosystem. European University Assoiation. Brussel, Belgium: asbl. https://eua.eu/downloads/publications/euainnovationecosystemreport2019-3-12.pdf
   Google Scholar
• Ristekbrin. (2020a). Innovation performance reporting guidelines 2020. Ministry of Research and Technology/ National Agency for Research and Innovation. https://lldikti14.kemdikbud.go.id/assets/berkas/d88750d96b594e6472724e4e36aa1a49.pdf
   Google Scholar
• Ristekbrin. (2020b). Performance Report of 2019. https://www.brin.go.id/informasi-publik/laporan-kinerja-2019
   Google Scholar
• Ristekbrin. (2021). Performance Report of 2020. https://www.brin.go.id/informasi-publik/laporan-kinerja-2020
   Google Scholar
• Sabah, F., Hassan, S. U., Muazzam, A., Iqbal, S., Soroya, S. H., & Sarwar, R. (2019). Scientific collaboration networks in Pakistan and their impact on institutional research performance: A case study based on Scopus publications. Library Hi Tech, 37(1), 19–29. https://doi.org/10/1108/LHT-03-2018-0036
   Web of Science ®Google Scholar
• Sabharwal, M. (2013). Comparing research productivity across disciplines and career stages. Journal of Comparative Policy Analysis: Research and Practice, 15(2), 141–163. https://doi.org/10.1080/13876988.2013.785149
   Web of Science ®Google Scholar
• Savithri, S., & Prathap, G. (2015). Indian and Chinese higher education institutions compared using an end-to-end evaluation. Current Science, 108(10 1922–1926). https://doi.org/10.1002/qj.2041.10
   Web of Science ®Google Scholar
• Schroeder, R., & Goldstein, S. M. (2016). Operations management in the supply chain: Decision and cases (7th ed.). McGraw-Hill Education.
   Google Scholar
• Sekaran, U., & Bougie, R. (2016). Research methods for business: A skill-building approach (7th ed.). John Wiley & Sons.
   Google Scholar
• Sim, J., & Waterfield, J. (2019). Focus group methodology: Some ethical challenges. Quality & Quantity, 53(6), 3003–3022. https://doi.org/10.1007/s11135-019-00914-5
   Google Scholar
• Siripitakchai, N., & Miyazaki, K. (2015). Assessment of research strengths using co-citation analysis: The case of Thailand national research universities. Research Evaluation, 24(4), 420–439. https://doi.org/10.1093/reseval/rvv018
   Web of Science ®Google Scholar
• Sizer, J., Spee, A., & Bormans, R. (1992). The rôle of performance indicators in higher education. Higher Education, 24(2), 133–155. http://doi.org/10/1007/BF00129438
   Web of Science ®Google Scholar
• Söderlind, J., & Geschwind, L. (2019). Making sense of academic work: The influence of performance measurement in Swedish universities. Policy Reviews in Higher Education, 3(1), 75–93. https://doi.org/10.1080/23322969.2018.1564354
   Google Scholar
• Tahira, M., Alias, R. A., & Bakri, A. (2015). Application of h and h-type indices at meso level: A case of Malaysian engineering research. Malaysian Journal of Library and Information Science, 20(3), 77–86. https://jummec.um.edu.my/index.php/MJLIS/article/view/1776
   Web of Science ®Google Scholar
• Tijssen, R., & Winnink, J. (2022). Global and local research excellence in Africa: New perspectives on performance assessment and funding. Science, Technology and Society, March, 097172182210782. https://doi.org/10.1177/09717218221078236
   Web of Science ®Google Scholar
• Tognolini, J., Adams, K., & Hattie, J. (1994). A methodology to choose performance indicators of research attainment in universities. Australian Journal of Education, 38(2), 105–117. https://doi.org/10.1177/000494419403800202
   Web of Science ®Google Scholar
• Tseng, F. C., Huang, M. H., & Chen, D. Z. (2018). Factors of university–industry collaboration affecting university innovation performance. Journal of Technology Transfer, 45(2), 560–577. http://doi.org/10.1007/s10961-018-9656-6
   Web of Science ®Google Scholar
• Vernon, M. M., Andrew Balas, E., Momani, S., & Bornmann, L. (2018). Are university rankings useful to improve research? A systematic review. PLoS ONE, 13(3), 1–15. https://doi.org/10.1371/journal.pone.0193762
   Web of Science ®Google Scholar
• Weber, R. P. (1990). Content analysis. In Basic content analysis (Quantitative Applications in the Social Sciences, Book 49) (2nd ed., pp. 117–124). Sage.
   Google Scholar
• Wood, F. (1990). Factors influencing research performance of university academic staff. Higher Education, 19(1), 81–100. https://doi.org/10.1007/BF00142025
   Web of Science ®Google Scholar
• Zhang, B., & Wang, X. (2017). Empirical study on influence of university-industry collaboration on research performance and moderating effect of social capital: Evidence from engineering academics in China. Scientometrics, 113(1), 257–277. https://doi.org/10.1007/s11192-017-2464-1
   Web of Science ®Google Scholar