Evaluating the Evaluators in Russia: When Academic Citizenship Fails

References

• Abramo, G., D’Angelo, C. & Caprasecca, A. (2009) ‘Gender Differences in Research Productivity. A Bibliometric Analysis of the Italian Academic System’, Scientometrics, 79, 3.
   Web of Science ®Google Scholar
• Abramo, G., Tindaro, C. & D’Angelo, C. (2013) ‘Individual Research Performance. A Proposal for Comparing Apples to Oranges’, Journal of Informetrics, 7, 2.
   PubMed Web of Science ®Google Scholar
• Abramov, R., Gruzdev, I. A. & Terent’yev, E. A. (2017) ‘Rabochee vremya i rolevye napryazheniya sotrudnikov sovremennogo Rossiyskogo universiteta’, Voprosy obrazovaniya, 1.
   Google Scholar
• Altbach, P. G. (1995) ‘Problems and Possibilities: The US Academic Profession’, Studies in Higher Education, 20, 1.
   Web of Science ®Google Scholar
• Alvesson, M. & Spicer, A. (2012) ‘A Stupidity-Based Theory of Organizations’, Journal of Management Studies, 49, 7.
   Web of Science ®Google Scholar
• Androushchak, G. & Yudkevich, M. (2012) ‘Russian Higher Education: Salaries and Contracts’, in Altbach, P., Reisberg, L., Yudkevich, M., Androuschak, G. & Pacheco, I. (eds) Paying the Professoriate: A Global Comparison of Compensation and Contracts (New York, NY, Routledge).
   Google Scholar
• Baccini, A., Barabesi, L., Cioni, M. & Pisani, C. (2014) ‘Crossing the Hurdle. The Determinants of Individual Scientific Performance’, Scientometrics, 101, 3.
   Web of Science ®Google Scholar
• Batista, P. D., Campiteli, M. G. & Kinouchi, O. (2006) ‘Is it Possible to Compare Researchers with Different Scientific Interests?’, Scientometrics, 68, 1.
   PubMed Web of Science ®Google Scholar
• Bazhanov, V. (2015) ‘Kakov smysl protsedury akkreditatsii vuzov?’, Troitskii variant, 6 October, available at: https://trv-science.ru/2015/10/kakov-smysl-procedury-akkreditacii-vuzov/, accessed 3 May 2021.
   Google Scholar
• Bergeron, D. M. (2007) ‘The Potential Paradox of Organizational Citizenship Behavior. Good Citizens at What Cost?’, Academy of Management Review, 32, 4.
   Web of Science ®Google Scholar
• Bergeron, D. M., Shipp, A. J., Rosen, B. & Furst, S. A. (2013) ‘Organizational Citizenship Behavior and Career Outcomes’, Journal of Management, 39, 4.
   Web of Science ®Google Scholar
• Biagioli, M., Kenney, M., Martin, B. R. & Walsh, J. P. (2019) ‘Academic Misconduct, Misrepresentation and Gaming: A Reassessment’, Research Policy, 48, 2.
   PubMed Web of Science ®Google Scholar
• Billing, D. (2004) ‘International Comparisons and Trends in External Quality Assurance of Higher Education. Commonality or Diversity?’, Higher Education, 47, 1.
   Web of Science ®Google Scholar
• Bolino, M., Klotz, A., Turnley, W. & Harvey, J. (2013) ‘Exploring the Dark Side of Organizational Citizenship Behavior’, Journal of Organizational Behavior, 34, 4.
   Web of Science ®Google Scholar
• Bonaccorsi, A. & Daraio, C. (2003) ‘Age Effects in Scientific Productivity. The Case of the Italian National Research Council (CNR)’, Scientometrics, 58, 1.
   PubMed Web of Science ®Google Scholar
• Broz, L. & Stöckelová, T. (2018) ‘The Culture of Orphaned Texts’, Aslib Journal of Information Management, 70, 6.
   Web of Science ®Google Scholar
• Carayol, N. & Matt, M. (2006) ‘Individual and Collective Determinants of Academic Scientists’ Productivity’, Information Economics and Policy, 18, 1.
   Web of Science ®Google Scholar
• Chavarro, D., Tang, P. & Rafols, I. (2017) ‘Why Researchers Publish in Non-Mainstream Journals. Training, Knowledge Bridging, and Gap Filling’, Research Policy, 46, 9.
   PubMed Web of Science ®Google Scholar
• Clark, B. (1983) The Higher Education System. Academic Organization in Cross-National Perspective (Berkeley, CA, University of California Press).
   Google Scholar
• Costas, R., van Leeuwen, T. N. & Bordons, M. (2010) ‘A Bibliometric Classificatory Approach for the Study and Assessment of Research Performance at the Individual Level. The Effects of Age on Productivity and Impact’, Journal of the Association for Information Science and Technology, 46, 2.
   Google Scholar
• Dubrovskiy, D. (2017) ‘Escape from Freedom. The Russian Academic Community and the Problem of Academic Rights and Freedoms’, Interdisciplinary Political Studies, 3, 1.
   Google Scholar
• Evetts, J. (2002) ‘New Directions in State and International Professional Occupations. Discretionary Decision-Making and Acquired Regulation’, Work, Employment and Society, 16, 2.
   Web of Science ®Google Scholar
• Farris, D. (2018) ‘Organisational Citizenship Behaviour in University Administrative Committees’, Journal of Higher Education Policy and Management, 40, 3.
   Web of Science ®Google Scholar
• Fox, M. F. (1983) ‘Publication Productivity among Scientists: A Critical Review’, Social Studies of Science, 13, 2.
   Web of Science ®Google Scholar
• Freidson, E. (1994) Professionalism Reborn. Theory, Prophecy, and Policy (Chicago, IL, University of Chicago Press).
   Google Scholar
• Froumin, I., Kouzminov, Y. & Semyonov, D. (2014) ‘Institutional Diversity in Russian Higher Education: Revolutions and Evolution’, European Journal of Higher Education, 4, 3.
   Google Scholar
• Froumin, I. & Lisyutkin, D. (2018) ‘The State as the Driver of Competitiveness in Russian Higher Education: The Case of Project 5–100’, in Oleksiyenko, A., Zha, Q., Chirikov, I. & Li, J. (eds) International Status Anxiety and Higher Education: The Soviet Legacy in China & Russia (Hong Kong, Springer).
   Google Scholar
• Gel’man, V. (2017) ‘Political Foundations of Bad Governance in Post-Soviet Eurasia. Towards a Research Agenda’, East European Politics, 33, 4.
   Web of Science ®Google Scholar
• Glänzel, W. & Schoepflin, U. (1999) ‘A Bibliometric Study of Reference Literature in the Sciences and Social Sciences’, Information Processing and Management, 35, 1.
   Web of Science ®Google Scholar
• Goode, W. J. (1960) ‘A Theory of Role Strain’, American Sociological Review, 25, 4.
   Web of Science ®Google Scholar
• Gounko, T. & Smale, W. (2007) ‘Modernization of Russian Higher Education. Exploring Paths of Influence’, Compare: A Journal of Comparative and International Education, 37, 4.
   Google Scholar
• Guba, K., Makeyeva, A., Sokolov, M. & Tsivinskaya, A. (2018) Kak rabotaet Rosobrnadzor: analiz otkrytykh dannykh o kontrol’no-nadzornoy deyatel’nosti v sfere vysshego obrazovaniya, Working Paper (St Petersburg, Tsentr institutsional’nogo analiza nauki i obrazovaniya).
   Google Scholar
• Guba, K., Sokolov, M. & Tsivinskaya, A. (2020) ‘Fictitious Efficiency: What the Russian Survey of Performance of Higher Education Institutions Actually Assessed’, Educational Studies Moscow, 1.
   Google Scholar
• Guskov, A., Kosyakov, D. & Selivanova, I. (2018) ‘Boosting Research Productivity in Top Russian Universities: The Circumstances of Breakthrough’, Scientometrics, 117, 2.
   Web of Science ®Google Scholar
• Hargens, L. L. (2000) ‘Using the Literature. Reference Networks, Reference Contexts, and the Social Structure of Scholarship’, American Sociological Review, 65, 6.
   Web of Science ®Google Scholar
• Harris-Huemmert, S. (2011) Evaluating Evaluators. An Evaluation of Education in Germany (Wiesbaden, VS Verlag für Sozialwissenschaften).
   Google Scholar
• Hicks, D. (2004) ‘The Four Literatures of Social Science’, in Moed, H. F., Glänzel, W. & Schmoch, U. (eds) Handbook of Quantitative Science and Technology Research. The Use of Publication and Patent Statistics in Studies of S&T Systems (Dordrecht & London, Kluwer Academic Publishers).
   Google Scholar
• Hicks, D. (2012) ‘Performance-based University Research Funding Systems’, Research Policy, 41, 2.
   Web of Science ®Google Scholar
• Ho, D., Imai, K., King, G. & Stuart, E. (2007) ‘Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference’, Political Analysis, 15, 3.
   Web of Science ®Google Scholar
• Jaeger, A. J. & Thornton, C. H. (2006) ‘Neither Honor nor Compensation: Faculty and Public Service’, Educational Policy, 20, 2.
   Web of Science ®Google Scholar
• Kaczmarska, K. (2018) ‘Academic Community and Policymaking in Russia’, Problems of Post-Communism, 66, 4.
   Web of Science ®Google Scholar
• Kelchtermans, S. & Veugelers, R. (2011) ‘The Great Divide in Scientific Productivity. Why the Average Scientist Does Not Exist’, Industrial and Corporate Change, 20, 1.
   Web of Science ®Google Scholar
• Langfeldt, L., Stensaker, B., Harvey, L., Huisman, J. & Westerheijden, D. F. (2010) ‘The Role of Peer Review in Norwegian Quality Assurance. Potential Consequences for Excellence and Diversity’, Higher Education, 59, 4.
   Web of Science ®Google Scholar
• Leslie, L. L. & Rhoades, G. (1995) ‘Rising Administrative Costs. Seeking Explanations’, Journal of Higher Education, 66, 2.
   Web of Science ®Google Scholar
• Levy, D. (2006) ‘The Unanticipated Explosion: Private Higher Education's Global Surge’, Comparative Education Review, 50, 2.
   Web of Science ®Google Scholar
• Long, J. S. (1978) ‘Productivity and Academic Position in the Scientific Career’, American Sociological Review, 43, 6.
   Web of Science ®Google Scholar
• Long, J. S. (1990) ‘The Origins of Sex Differences in Science’, Social Forces, 68, 4.
   Web of Science ®Google Scholar
• Long, J. S. & Fox, M. F. (1995) ‘Scientific Careers. Universalism and Particularism’, Annual Review of Sociology, 21.
   Web of Science ®Google Scholar
• Lotka, A. J. (1926) ‘The Frequency Distribution of Scientific Productivity’, Journal of the Washington Academy of Sciences, 16, 12.
   Google Scholar
• Louis, K. S., Anderson, M. S. & Rosenberg, L. (1995) ‘Academic Misconduct and Values. The Department’s Influence’, The Review of Higher Education, 18, 4.
   Web of Science ®Google Scholar
• Lawrence, J., Ott, M. & Bell, A. (2012) ‘Faculty Organizational Commitment and Citizenship’, Research in Higher Education, 53.
   PubMed Web of Science ®Google Scholar
• Macfarlane, B. (2008) ‘Defining and Rewarding Academic Citizenship. The Implications for University Promotions Policy’, Journal of Higher Education Policy and Management, 29, 3.
   Google Scholar
• Mamiseishvili, K., Miller, M. T. & Lee, D. (2016) ‘Beyond Teaching and Research. Faculty Perceptions of Service Roles at Research Universities’, Innovative Higher Education, 41, 4.
   Web of Science ®Google Scholar
• Matveeva, N., Sterligov, I. & Yudkevich, M. (2021) ‘The Effect of Russian University Excellence Initiative on Publications and Collaboration Patterns’, Journal of Infometrics, 15, 1.
   Google Scholar
• McDowell, J., Singell, L. & Stater, M. (2009) ‘Congratulations or Condolences? The Role of Human Capital in the Cultivation of a University Administrator’, Economics of Education Review, 28.
   Web of Science ®Google Scholar
• Milem, J. F., Berger, J. B. & Dey, E. L. (2000) ‘Faculty Time Allocation: A Study of Change Over Twenty Years’, Journal of Higher Education, 71, 4.
   Web of Science ®Google Scholar
• Miller, D. (1993) ‘The Architecture of Simplicity’, Academy of Management Review, 18, 1.
   Web of Science ®Google Scholar
• Minina, E. (2016) ‘“Quality Revolution” in Post-Soviet Education in Russia. From Control to Assurance?’, Journal of Education Policy, 32, 2.
   Web of Science ®Google Scholar
• Minina, E., Piattoeva, N., Centeno, V. G., Zhou, X., Candido, H. & Hinke, D. (2018) ‘Transnational Policy Borrowing and National Interpretations of Educational Quality in Russia, China and Brazil’, in Chankseliani, M. & Silova, I. (eds) Comparing Post-Socialist Transformations. Purposes, Policies, and Practices in Education (Oxford, Symposium Books).
   Google Scholar
• Moed, H., Markusova, V. & Akoev, M. (2018) ‘Trends in Russian Research Output Indexed in Scopus and Web of Science’, Scientometrics, 116, 2.
   Web of Science ®Google Scholar
• Moskaleva, O., Pislyakov, V., Sterligov, I., Akoev, M. & Shabanova, S. (2018) ‘Russian Index of Science Citation. Overview and Review’, Scientometrics, 116, 1.
   Web of Science ®Google Scholar
• Mutz, R. & Daniel, H.-D. (2019) ‘How to Consider Fractional Counting and Field Normalization in the Statistical Modeling of Bibliometric Data. A Multilevel Poisson Regression Approach’, Journal of Informetrics, 13, 2.
   Web of Science ®Google Scholar
• Nechepurenko, I. (2018) ‘In Russia, a Top University Lacks Just One Thing: Students’, New York Times, 26 August, available at: https://www.nytimes.com/2018/08/26/world/europe/european-university-st-petersburg-russia.html, accessed 7 May 2021.
   Google Scholar
• Nederhof, A. J. (2006) ‘Bibliometric Monitoring of Research Performance in the Social Sciences and the Humanities. A Review’, Scientometrics, 66, 1.
   Web of Science ®Google Scholar
• Neumann, A. & Terosky, A. (2007) ‘To Give and to Receive. Recently Tenured Professors’ Experiences of Service in Major Research Universities’, The Journal of Higher Education, 78, 3.
   Web of Science ®Google Scholar
• Oliver, C. (1991) ‘Strategic Responses to Institutional Processes’, Academy of Management Review, 16, 1.
   Web of Science ®Google Scholar
• Piperski, A. (2020) ‘Budni prepodavatelya: RPD, PK-16, PUD i izhe s nimi’, Troitskii variant, 28 January, available at: https://trv-science.ru/2020/01/budni-prepodavatelya-vuza/, accessed 3 May 2021.
   Google Scholar
• Platonova, D. & Semyonov, D. (2018) ‘Russia: The Institutional Landscape of Russian Higher Education’, in Huisman, J., Smolentseva, A., Froumin, I. (eds) 25 Years of Transformations of Higher Education Systems in Post-Soviet Countries. Reform and Continuity (New York, NY, Palgrave Macmillan).
   Google Scholar
• Qiu, J. (2010) ‘Publish or Perish in China’, Nature, 463, 7278.
   Web of Science ®Google Scholar
• Rebora, G. & Turri, M. (2011) ‘Critical Factors in the Use of Evaluation in Italian Universities’, Higher Education, 61, 5.
   Web of Science ®Google Scholar
• Rijcke, S., Wouters, P. F., Rushforth, A. D., Franssen, T. P. & Hammarfelt, B. (2016) ‘Evaluation Practices and Effects of Indicator Use—A Literature Review’, Research Evaluation, 25, 2.
   Web of Science ®Google Scholar
• Romzek, B. S. (2000) ‘Dynamics of Public Sector Accountability in an Era of Reform’, International Review of Administrative Sciences, 66, 1.
   Web of Science ®Google Scholar
• Rousseau, R., Egghe, L. & Guns, R. (2018) Becoming Metric-Wise. A Bibliometric Guide for Researchers (Cambridge, MA, Chandos Publishing).
   Google Scholar
• Rudakov, V. N. & Prakhov, I. A. (2021) ‘Gender Differences in Pay among University Faculty in Russia’, Higher Education Quarterly, 75, 2.
   Web of Science ®Google Scholar
• Seglen, P. O. (1992) ‘The Skewness of Science’, Journal of the Association for Information Science and Technology, 43, 9.
   Google Scholar
• Shibanova, E., Platonova, D. & Lisyutkin M. (2018) ‘5–100: Development Dynamics and Patterns’, Russian Education and Society, 60, 8–9.
   Google Scholar
• Sivak, E. & Yudkevich, M. (2015) ‘Academic Immobility and Inbreeding in Russian Universities’, in Yudkevich, M., Altbach, P. & Rumbley, L. (eds) Academic Inbreeding and Mobility in Higher Education (New York, NY, Palgrave Macmillan).
   Google Scholar
• Sivak, E. & Yudkevich, M. (2017) ‘The Academic Profession in Russia’s Two Capitals: The Impact of 20 Years of Transition’, European Educational Research Journal, 16, 5.
   Web of Science ®Google Scholar
• Smolentseva, A. (2017) ‘Where Soviet and Neoliberal Discourses Meet. The Transformation of the Purposes of Higher Education in Soviet and Post-Soviet Russia’, Higher Education, 74, 6.
   Web of Science ®Google Scholar
• Sterligov, I. (2017) ‘The Monster Ten You Have Never Heard of: Top Russian Scholarly Megajournals’, Higher Education in Russia and Beyond, 1, 11.
   Google Scholar
• Suspitsin, D. (2007) ‘Between the State and the Market: Sources of Sponsorship and Legitimacy in Russian Nonstate Higher Education’, in Slantcheva, S. & Levy, D. (eds) Private Higher Education in Post-Communist Europe, Search of Legitimacy (New York, NY, Palgrave Macmillan).
   Google Scholar
• Tomusk, V. (2004) The Open World and Closed Societies. Essays on Higher Education Policies in Transition (New York, NY, Palgrave Macmillan).
   Google Scholar
• van Dyne, L., Cummings, L. L. & McLean Parks, J. (1995) ‘Extra-role Behaviors: in Pursuit of Construct and Definitional Clarity (A Bridge Over Muddied Waters)’, Research in Organizational Behavior, 17.
   Web of Science ®Google Scholar
• van Leeuwen, T. N., Visser, M. S., Moed, H. F., Nederhof, T. & Van Raan, A. (2003) ‘The Holy Grail of Science Policy. Exploring and Combining Bibliometric Tools in Search of Scientific Excellence’, Scientometrics, 57, 2.
   Web of Science ®Google Scholar
• van Vught, F. A. & Westerheijden, D. F. (1994) ‘Towards a General Model of Quality Assessment in Higher Education’, Higher Education, 28, 3.
   Web of Science ®Google Scholar
• Wildgaard, L., Schneider, J. W. & Larsen, B. (2014) ‘A Review of the Characteristics of 108 Author-Level Bibliometric Indicators’, Scientometrics, 101, 1.
   Web of Science ®Google Scholar
• Wood, S. N., Pya, N. & Säfken, B. (2016) ‘Smoothing Parameter and Model Selection for General Smooth Models’, Journal of the American Statistical Association, 111, 516.
   Web of Science ®Google Scholar