Epistemic capacity in research environments: a framework for process evaluation

References

• Abramo , G. , D’Angelo , C. and Di Costa , F. 2009 . Mapping excellence in national research systems: the case of Italy . Evaluation Review , 33 ( 2 ) : 159 – 188 .
   PubMed Web of Science ®Google Scholar
• Boyer, E.L. (1990) Scholarship Reconsidered: Priorities of the Professoriate, Princeton University Press, Princeton, NJ.
   Google Scholar
• Cole , S. , Rubin , L. and Cole , J. 1978 . Peer Review in the National Science Foundation , Washington , DC : National Academy of Sciences .
   Google Scholar
• Davidson , D. 1980 . Essays on Actions and Events , Oxford : Clarendon Press .
   Google Scholar
• European Commission (EC) (2010) Interim Evaluation of the Seventh Framework Programme, European Commission, Brussels.
   Google Scholar
• European Commission (EC) (2012) Guidance Notes on Project Reporting, European Commission, Brussels.
   Google Scholar
• Feller , I. 2002 . Performance management redux . American Journal of Evaluation , 23 ( 4 ) : 435 – 452 .
   Web of Science ®Google Scholar
• Garfield , E. 1964 . Science Citation Index – a new dimension in indexing . Science , 144 ( 3619 ) : 649 – 654 .
   PubMed Web of Science ®Google Scholar
• Georghiou , L. and Meyer-Krahmer , F. 1992 . Evaluation of socio-economic effects of European Community R&D programmes in the SPEAR network . Research Evaluation , 2 ( 1 ) : 5 – 15 .
   Google Scholar
• Giorgi , A. 1997 . The theory, practice and evaluation of the phenomenological method as a qualitative research procedure . Journal of Phenomenological Psychology , 28 : 235 – 260 .
   Google Scholar
• Gläser, J. and Laudel, G. (2007) ‘Evaluation without evaluators: the impact of funding formulae on Australian university research’ in Whitley, R., Barker, K. and Gläser, J. (eds) The Changing Governance of the Sciences: The Advent of Research Evaluation Systems, Springer, Dordrecht, pp.101–23.
   Google Scholar
• Heinze , T. , Shapira , P. , Rogers , J. and Senker , M. 2009 . Organizational and institutional influences on creativity in scientific research . Research Policy , 38 : 610 – 623 .
   Web of Science ®Google Scholar
• Hellström , T. 2011 . Homing in on excellence. dimension of appraisal in Center of Excellence program evaluations . Evaluation , 17 ( 2 ) : 117 – 131 .
   Google Scholar
• Hellström , T. and Jacob , M. 2003 . Knowledge without goals: Evaluation of knowledge management programs . Evaluation , 9 ( 1 ) : 55 – 72 .
   Google Scholar
• Hemlin , S. , Allwood , C. and Martin , B. 2004 . “ What is a creative knowledge environment? ” . In Creative Knowledge Environments: The Influences on Creativity in Research and Innovation , Edited by: Hemlin , S. , Allwood , C. and Martin , B. 1 – 28 . Cheltenham : Edward Elgar .
   Google Scholar
• Hemlin , S. and Barlebo Rasmussen , S. 2006 . The shift in academic quality control . Science, Technology and Human Values , 31 ( 2 ) : 173 – 198 .
   Web of Science ®Google Scholar
• Hollingsworth, R. and Hollingsworth, E. (2000) ‘Major discoveries in biomedical research organizations: perspectives on interdisciplinarities, nurturing leadership, and integrated structures and cultures’ in Weingart, P. and Stehr, N. (eds) Practicing Interdisciplinarity, University of Toronto Press, Toronto, pp.215–44.
   Google Scholar
• Hong , H. and Boden , M. 2003 . R&D Programme Evaluation – Theory and Practice , Aldershot : Ashgate .
   Google Scholar
• Huutoniemi, K. (2010) ‘Evaluating interdisciplinary research’ in Frodeman, R., Klein, J. and Mitcham, C. (eds) Oxford Handbook of Interdisciplinarity, Oxford University Press, Oxford, pp.309–20.
   Google Scholar
• Kitcher , P. 2001 . Science, Truth, and Democracy , Oxford : Oxford University Press .
   Google Scholar
• Klein, J. (2008) ‘Evaluation of interdisciplinary and transdisciplinary research: a literature review’, American Journal of Preventive Medicine, 35, 2S, pp.116–23.
   Google Scholar
• Kostoff , R. 1998 . The use and misuse of citation analysis in research evaluation . Scientometrics , 43 ( 1 ) : 27 – 43 .
   Web of Science ®Google Scholar
• Leonard-Barton , D. 1998 . Wellsprings of Knowledge: Building and Sustaining the Sources of Innovation , Harvard , MA : Harvard Business Review Press .
   Google Scholar
• Love, A.J. ed (1983) Special Issue: Developing Effective Internal Evaluation. New Directions for Program Evaluation, 20, pp.1–103.
   Google Scholar
• Martin, B., Allwood, C. and Hemlin, S. (2004) ‘Conclusions: how to stimulate creative knowledge environments’ in Hemlin, S., Allwood, C. and Martin, B. (eds) Creative Knowledge Environments: The Influences on Creativity in Research and Innovation, Edward Elgar, Cheltenham, pp.193–220.
   Google Scholar
• Merton , R. 1979 . The Sociology of Science Theoretical and Empirical Investigations , Chicago , IL : University of Chicago Press .
   Google Scholar
• Pfirman, S. and Martin, P. (2010) ‘Facilitating interdisciplinary scholars’ in Frodeman, R., Klein, J. and Mitcham, C. (eds) Oxford Handbook of Interdisciplinarity, Oxford University Press, Oxford, pp.386–403.
   Google Scholar
• Pounder , J. 2000 . Evaluating the relevance of quality to institutional performance assessment in higher education . Evaluation , 6 ( 1 ) : 66 – 78 .
   Google Scholar
• Rossi , P. and Freeman , H. 1993 . Evaluation: A Systematic Approach , Newbury Park , CA : Sage .
   Google Scholar
• Scriven , M. 1991 . Evaluation Thesaurus , Newbury Park , CA : Sage .
   Google Scholar
• Scriven, M. (2007) ‘The logic of evaluation’ in Hansen, H. (ed.) Dissensus and the Search for Common Ground, OSSA, Windsor, ON, pp.1–16.
   Google Scholar
• Scriven, M. and Coryn, C. (2008) ‘The logic of research evaluation’ in Coryn, C. and Scriven, M. (eds) Reforming the Evaluation of Research. New Directions for Evaluation, 118, pp.89–105.
   Google Scholar
• Stufflebeam, D. (1981) ‘Meta-evaluation: concepts, standards and uses’ in Berk, R. (ed.) Educational Evaluation Methodology: The State of the Art, Johns Hopkins University Press, Baltimore, MD, pp.146–63.
   Google Scholar
• Thomas , D. 2006 . A general inductive approach for analyzing qualitative evaluation data . American Journal of Evaluation , 27 ( 2 ) : 237 – 246 .
   Web of Science ®Google Scholar
• Thorngate , W. , Dawes , R. and Foddy , M. 2009 . Judging Merit , New York : Psychology Press/Taylor and Francis .
   Google Scholar
• Tjissen , R. 2003 . Scoreboards of research excellence . Research Evaluation , 12 ( 2 ) : 91 – 103 .
   Web of Science ®Google Scholar
• Trochim , W. , Marcus , S. , Masse , L. , Moser , R. and Weld , P. 2008 . The evaluation of large research initiatives: a participatory integrative mixed-methods approach . American Journal of Evaluation , 29 ( 1 ) : 8 – 28 .
   Web of Science ®Google Scholar
• Vetenskapsradet (2006) Press releases 2006-07-07, available from http://www.vr.se [accessed 24 July 2012].
   Google Scholar
• Weiss , C. 1997 . How can theory-based evaluation make greater headway? . Evaluation Review , 21 ( 4 ) : 501 – 524 .
   Web of Science ®Google Scholar
• Woodman , R. , Sawyer , J. and Griffin , R. 1993 . Toward a theory of organizational creativity . Academy of Management Review , 18 ( 2 ) : 293 – 321 .
   Web of Science ®Google Scholar