Mechanisms Shaping an Evaluation System—A Case Study of Poland 1999–2010

References

• Anderson, V. & Johnson, L. (1997) Systems Thinking Basics: From Concepts to Causal Loops (Waltham, MA, Pegasus Communications)
   Google Scholar
• Argyris, C. (1977) ‘Double-Loop Learning in Organizations’, Harvard Business Review, 55, 5.
   Web of Science ®Google Scholar
• Argyris, C. (1999) On Organizational Learning, 2nd edn (Oxford, Wiley-Blackwell)
   Google Scholar
• Astbury, B. & Leeuw, F. L. (2010) ‘Unpacking Black Boxes: Mechanisms and Theory Building in Evaluation’, American Journal of Evaluation, 31, 3.
   Web of Science ®Google Scholar
• Bachtler, J. (2001) ‘Quod erat demonstrandum? Ewaluacja polityki regionalnej’, Studia Regionalne i Lokalne, 4, 7.
   Google Scholar
• Bachtler, J. & Wren, C. (2006) ‘Evaluation of European Union Cohesion Policy: Research Questions and Policy Challenges’, Regional Studies, 40, 2.
   Web of Science ®Google Scholar
• Barrados, M. & Mayne, J. (2003) ‘Can Public Sector Organisations Learn?’, OECD Journal on Budgeting, 3, 3.
   Google Scholar
• Batterbury, S. (2006) ‘Principles and Purposes of European Union Cohesion Policy Evaluation’, Regional Studies, 40, 2.
   Web of Science ®Google Scholar
• Bennet, A. & Bennet, D. (2004) ‘The Partnership between Organizational Learning and Knowledge Management’, in Holsapple, C. (ed.) Handbook on Knowledge Management 1: Knowledge Matters (Heidelberg, Springer)
   Google Scholar
• Bienias, S. (2009) ‘Evaluation of Structural Instruments in Poland’, paper for the conference Evaluation of EU Structural Funds: Reinforcing Quality and Utilization, Ministry of Economics, Vilnius, Lithuania, 26–27 March 2009.
   Google Scholar
• Bienias, S. (2011) ‘Evidence-based Cohesion Policy and its Role in Achieving Europe 2020 Objectives. Conference Background Report’, paper to the Opening Conference of the Polish Presidency in the European Union, Gdańsk, 7–8 July.
   Google Scholar
• Boni, M. (ed.) (2009) Polska 2030—Wyzwania rozwojowe (Warsaw, Kancelaria Prezesa Rady Ministrów)
   Google Scholar
• Broda, B., Maziarz, M., Piekot, T., Poprawa, M., Radziszewski, A. & Zarzeczny, G. (2011) Język raportów ewaluacyjnych (Warszaw, Ministerstwo Rozwoju Regionalnego)
   Google Scholar
• Checkland, P. (1999) Systems Thinking, Systems Practice: Includes a 30-Year Retrospective (New York, Wiley)
   Google Scholar
• Chelimsky, E. (1985) Program Evaluation: Patterns and Directions (Washington, DC, American Society for Public Administration)
   Google Scholar
• Cousins, B. J. & Whitmore, E. (1998) ‘Framing Participatory Evaluation’, New Directions for Evaluation, 80, Winter.
   Google Scholar
• Dahler-Larsen, P. (2005) ‘Evaluation in Public Management’, in Ferlie, E., Lynn, L. E. & Pollitt, C. (eds) The Oxford Handbook of Public Management (Oxford, Oxford University Press)
   Google Scholar
• Davies, H., Nutley, S. & Smith, P. (eds) (2009) What Works? Evidence-based Policy and Practice in Public Services (Bristol, Policy Press)
   Google Scholar
• Derlien, H. U. (1990) ‘Genesis and Structure of Evaluation Efforts in Comparative Perspective’, in Rist, R. C. (ed.) Program Evaluation and the Management of Government: Patterns and Prospects across Eight Nations (London, Transaction Publishers)
   Google Scholar
• Donaldson, S., Patton, M., Fetterman, D. & Scriven, M. (2010) ‘The 2009 Claremont Debates: The Promise and Pitfalls of Utilization-Focused and Empowerment Evaluation’, Journal of Multidisciplinary Evaluation, 6, 13.
   Google Scholar
• Donaldson, S. I. (2007) Program Theory-Driven Evaluation Science: Strategies and Applications (New York, Lawrence Erlbaum)
   Google Scholar
• EGO s.c. (2010a) Badanie potencjału oraz stanu dotychczasowych prac w ramach jednostek ewaluacyjnych funkcjonujących w Instytucjach Zarządzający oraz Instytucjach Pośredniczących I i II stopnia w ramach NPR 2004–2006 i NSRO 2007–2013 (Warszaw, Ministerstwo Rozwoju Regionalnego)
   Google Scholar
• EGO s.c. (2010b) Ocena systemu realizacji polityki spójności w Polsce w ramach perspektywy 2004–2006 (Warsaw, Ministerstwo Rozwoju Regionalnego—Krajowa Jednostka Oceny)
   Google Scholar
• Ferry, M. (2009) ‘Cohesion Policy Evaluation Systems in the Visegrad Member States: An Overview’, in Bienias, S. & Lewandowska, I. (eds) Evaluation Systems in the Visegrad Member States (Warsaw, Ministry of Regional Development)
   Google Scholar
• Ferry, M. & Olejniczak, K. (2008) The Use of Evaluation in the Management of EU Programmes in Poland (Warsaw, Ernst & Young—Program ‘Sprawne Państwo’)
   Google Scholar
• Fetterman, D. & Wandersman, A. (2007) ‘Empowerment Evaluation: Yesterday, Today, and Tomorrow’, American Journal of Evaluation, 28, 2.
   Web of Science ®Google Scholar
• Forunier, D. M. (2005) ‘Evaluation Defined’, in Mathison, S. (ed.) Encyclopedia of Evaluation (Thousand Oakes, CA, Sage Publications)
   Google Scholar
• Furubo, J.-E., Rist, R. C. & Sandahl, R. (2002) International Atlas of Evaluation (New Brunswick, NJ, Transaction Publishers)
   Google Scholar
• Hummelbrunner, R. (2007) ‘Systemic Evaluation in the Field of Regional Development’, in Williams, B. & Imam, I. (eds) Systems Concepts in Evaluation. An Expert Anthology (Ann Arbor, MI, American Evaluation Association)
   Google Scholar
• Hummelbrunner, R. (2011) ‘Applying Systems Thinking to Evaluation of Structural Funds’, in Olejniczak, K., Kozak, M. & Bienias, S. (eds) Evaluating the Effects of Regional Interventions. A Look Beyond Current Structural Funds' Practice (Warsaw, Ministry of Regional Development)
   Google Scholar
• King, J. A. (1998) ‘Making Sense of Participatory Evaluation Practice’, New Directions for Evaluation, 80, Winter.
   Google Scholar
• Kozak, M. (2007) ‘Managing European Regional Policy in Poland in the Initial Period after the Accession’, Regional and Local Studies (Studia Regionalne i Lokalne), Special Issue, available at: http://www.studreg.uw.edu.pl/archiwum_new.php?rok = 2007#, accessed 15 August 2011.
   Google Scholar
• Kozak, M., Ledzion, B., Olejniczak, K. & Wojtowicz, D. (2009) Ex Post Evaluation of Cohesion Policy Programmes 2000–06 Co-financed by ERDF. Management and Implementation Systems for Cohesion Policy, National Assessment Report Poland (Brussels, EPRC & EUROREG)
   Google Scholar
• Lane, D. (2008) ‘The Emergence and Use of Diagramming in System Dynamics: A Critical Account’, Systems Research and Behavioral Science, 25, 1.
   Web of Science ®Google Scholar
• Leeuw, F. L. & Furubo, J.-E. (2008) ‘Evaluation Systems: What Are They and Why Study Them?’, Evaluation, 14, 2.
   Google Scholar
• Leeuw, F. L., Rist, R. C. & Sonnichsen, R. C. (1994) Can Governments Learn?: Comparative Perspectives on Evaluation & Organizational Learning (London, Transaction Publishers)
   Google Scholar
• Meadows, D. H. (2008) Thinking in Systems: A Primer (Vermont, Chelsea Green Publishing)
   Google Scholar
• Nutley, S. M., Walter, I. & Davies, H. T. O. (2007) Using Evidence: How Research Can Inform Public Services (Bristol, Policy Press)
   Google Scholar
• OECD (2001) Territorial Outlook (Paris, OECD)
   Google Scholar
• Olejniczak, K. (2011) ‘Tracing Theories Behind Practice—A Theory-Driven Approach’, in Olejniczak, K., Kozak, M. & Bienias, S. (eds)
   Google Scholar
• Olejniczak, K., Kozak, M. & Bienias, S. (eds) (2011) Evaluating the Effects of Regional Interventions. A Look Beyond Current Structural Funds' Practice (Warsaw, Ministry of Regional Development), available at: [email protected], accessed 15 August 2012.
   Google Scholar
• Olejniczak, K. & Ledzion, B. (eds) (2013) Ocena systemu realizacji polityki spójności w Polsce w ramach perspektywy 2007–2013 (Warszawa, EGO s.c. dla Ministerstwa Rozwoju Regionalnego—Krajowej Jednostki Oceny)
   Google Scholar
• Olejniczak, K., Ledzion, B. & Pander, W. (2008) Ocena potencjału oraz stanu prac w ramach jednostek ewaluacyjnych funkcjonującyh w Instytucjach Zarządzających oraz Instytucjach Pośredniczacych I i II stopnia w ramach NPR 2004–2006 i NSRO 2007–13 (Warszawa, EGO s.c. dla Krajowej Jednostki Oceny)
   Google Scholar
• Olejniczak, K., Strzęboszewski, P. & Bienias, S. (eds) (2011) Review of the Evaluation Practices in the European Union. Perspectives of 27 Member States (Draft Report for Polish Presidency) (Warsaw, Ministry of Regional Development)
   Google Scholar
• Osborne, D. & Gaebler, T. (1992) Reinventing Government: How the Entrepreneurial Spirit is Transforming the Public Sector (Reading, MA, Addison-Wesley)
   Google Scholar
• Ostrom, E. (2005) Understanding Institutional Diversity (Princeton, NJ & Woodstock, Princeton University Press)
   Google Scholar
• Patton, M. Q. (2010) Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use (New York, The Guilford Press)
   Google Scholar
• Pawson, R. (2006) Evidence-Based Policy: A Realist Perspective (London, Sage)
   Google Scholar
• Pollitt, C. (1998) ‘Evaluation in Europe. Boom or Bubble?’, Evaluation, 4, 2.
   Google Scholar
• Preskill, H. & Torres, D. R. T. (1999) Evaluative Inquiry for Learning in Organizations (Thousand Oaks, CA, Sage Publications)
   Google Scholar
• PTE (2011) Polski rynek badań ewaluacyjnych w roku 2010 (Warszawa, Polskie Towarzystwo Ewaluacyjne)
   Google Scholar
• Ramage, M. & Shipp, K. (2009) Systems Thinkers (London, Springer)
   Google Scholar
• Smith, P. (1995) ‘On the Unintended Consequences of Publishing Performance Data in the Public Sector’, International Journal of Public Administration, 18, 2.
   Google Scholar
• Sterman, J. (2000) Business Dynamics: Systems Thinking and Modelling for a Complex World (Boston, MA, McGraw-Hill/Irwin)
   Google Scholar
• Stone, D. (2011) Policy Paradox: The Art of Political Decision Making, 3rd edn (New York & London, W.W. Norton)
   Google Scholar
• Torres, R., Preskill, H. & Piontek, M. (2005) Evaluation Strategies for Communicating and Reporting (Thousand Oaks, CA, Sage Publications)
   Google Scholar
• Van der Knaap, P. (2000) ‘Performance Management and Policy Evaluation in the Netherlands’, Evaluation, 6, 3.
   Google Scholar
• Weiss, C. H. & Bucuvalas, M. J. (1980) ‘Truth Tests and Utility Tests: Decision-Makers' Frame of Reference for Social Science Research’, American Sociological Review, 45, 2.
   Web of Science ®Google Scholar
• ZBN PTS (2010) Badanie metaewaluacyjne treści dokumentacji przetargowych zwięzanych z wykonaniem badań ewaluacyjnych w latach 2008–2010 (Warsaw, Zakład Badań Naukowych Polskiego Towarzystwa Socjologicznego na zlecenie Ministerstwa Rozwoju Regionalnego)
   Google Scholar