Cumulating evidence in environmental governance, policy and planning research: towards a research reform agenda

References

• Banville, C., & Landry, M. (1989). Can the field of MIS be disciplined? Communications of the ACM, 32(1)(1), 48–60. https://doi.org/10.1145/63238.63241
   Web of Science ®Google Scholar
• Bennett, A., & Checkel, J. T. (Eds.). (2015). Process tracing: From metaphor to analytic tool. Cambridge University Press.
   Google Scholar
• Biermann, F., Betsill, M. M., Gupta, J., Kanie, N., Lebel, L., Liverman, D., Schroeder, H., Siebenhüner, B., & Zondervan, R. (2010). Earth system governance: A research framework. International Environmental Agreements: Politics, Law and Economics, 10(4), 277–298. https://doi.org/10.1007/s10784-010-9137-3
   Web of Science ®Google Scholar
• Blatter, J., & Haverland, M. (2014). Designing case studies: Explanatory approaches in small-N research, research methods series. Palgrave Macmillan.
   Google Scholar
• Cashore, B., & Bernstein, S. (2020, January). Bringing the environment back [Paper presentation]. Overcoming the Tragedy of the Diffusion of the Commons Metaphor, substantially revised version of papers presented to the Ostrom Workshop at Indiana University April 23rd, 2018, Bloomington, Indiana and the International Studies Association Annual Meeting, San Francisco, April 3–7th, 2018.
   Google Scholar
• Driessen, P. P. J., Dieperink, C., van Laerhoven, F., Runhaar, H. A. C., & Vermeulen, W. J. V. (2012). Towards a conceptual framework for the study of shifts in modes of environmental governance – experiences from The Netherlands. Environmental Policy and Governance, 22(3), 143–160. https://doi.org/10.1002/eet.1580
   Web of Science ®Google Scholar
• Dunning, E., & Mennell, S. (Eds.). (2003). Sage masters of modern social thought: Norbert Elias. Sage.
   Google Scholar
• Emerson, K., & Nabatchi, T. (2015). Collaborative governance regimes. Georgetown University Press.
   Google Scholar
• Freese, J., & Peterson, D. (2017). Replication in social science. Annual Review of Sociology, 43(1), 147–165. https://doi.org/10.1146/annurev-soc-060116-053450
   Google Scholar
• Fritsch, O., & Newig, J. (in prep.). Applications of meta-analysis and case survey in public policy – a systematic review, to be submitted to International Public Policy Review.
   Google Scholar
• Geels, F. W. (2002). Technological transitions as evolutionary reconfiguration processes: A multi-level perspective and a case-study. Research Policy, 31(8-9), 1257–1274. https://doi.org/10.1016/S0048-7333(02)00062-8
   Web of Science ®Google Scholar
• Gerring, J. (2015). Social science methodology: A unified framework. 2nd ed., strategies for social inquiry. Cambridge University Press.
   Google Scholar
• Gilpin, A. (1996). Dictionary of environment and sustainable development. Wiley.
   Google Scholar
• Glass, G. V. (1977). Integrating findings: The meta-analysis of research. Review of Research in Education, 5, 351–379.
   Google Scholar
• Goertz, G. (2011). Social science concepts: A user's guide. Princeton University Press.
   Google Scholar
• Goyal, N., & Howlett, M. (2018). Lessons learned and not learned: Bibliometric analysis of policy learning. In C. A. Dunlop, C. M. Radaelli, & P. Trein (Eds.), Learning in public policy. Analysis, modes and outcomes (pp. 27–49). Palgrave Macmillan.
   Google Scholar
• Grafton, R. Q., Pendleton, L. H., & Nelson, H. W. (2001). A dictionary of environmental economics, science, and policy. Edward Elgar Publishing.
   Google Scholar
• Grönlund, Å, & Åström, J. (2009). DoIT right: Measuring effectiveness of different eConsultation designs. Springer.
   Google Scholar
• Hammarfelt, B. (2017). Recognition and reward in the academy: Valuing publication oeuvres in biomedicine, economics and history. Aslib Journal of Information Management, 69(5), 607–623. https://doi.org/10.1108/AJIM-01-2017-0006
   Web of Science ®Google Scholar
• Hill, M., & Hupe, P. (2003). The multi-layer problem in implementation research. Public Management Review, 5(4), 471–490. https://doi.org/10.1080/1471903032000178545
   Google Scholar
• Hirsch Hadorn, G., Bradley, D., Pohl, C., Rist, S., & Wiesmann, U. (2006). Implications of transdisciplinarity for sustainability research. Ecological Economics, 60(1), 119–128. https://doi.org/10.1016/j.ecolecon.2005.12.002
   Web of Science ®Google Scholar
• Hooghe, L., & Marks, G. (2003). Unraveling the central state, but how? Types of multi-level governance. American Political Science Review, 97(2), 233–243.
   Web of Science ®Google Scholar
• Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis. Correcting error and bias in research findings. Sage.
   Google Scholar
• Jensen, J. L., & Rodgers, R. (2001). Cumulating the intellectual gold of case study research. Public Administration Review, 61(2), 235–246. https://doi.org/10.1111/0033-3352.00025
   Web of Science ®Google Scholar
• Jordan, A. (2008). The governance of sustainable development: Taking stock and looking forwards. Environment and Planning C: Government and Policy, 26(1), 17–33. https://doi.org/10.1068/cav6
   Web of Science ®Google Scholar
• King, G., Keohane, R. O., & Verba, S. (1994). Designing social inquiry. Scientific inference in qualitative research. Princeton University Press.
   Google Scholar
• Kingdon, J. W. (1999). Agendas, alternatives, and public policies. Longman.
   Google Scholar
• Kiser, L. L., & Ostrom, E. (1982). The three worlds of action: A metatheoretical synthesis of institutional approaches. In E. Ostrom (Ed.), Strategies of political inquiry (pp. 179–222). Sage.
   Google Scholar
• Klein, J. T. (2004). Prospects for transdisciplinarity. Futures, 36(4), 515–526. https://doi.org/10.1016/j.futures.2003.10.007
   Web of Science ®Google Scholar
• Kooiman, J. (2003). Governing as governance. Sage.
   Google Scholar
• Lange, P., Bornemann, B., & Burger, P. (2019). Sustainability impacts of governance modes: Insights from Swiss energy policy. Journal of Environmental Policy and Planning, 21(2), 174–187. https://doi.org/10.1080/1523908X.2019.1566062
   Web of Science ®Google Scholar
• Larsson, R. (1993). Case survey methodology: Quantitative analysis of patterns across case studies. Academy of Management Journal, 36(6), 1515–1546. https://doi.org/10.5465/256820
   Web of Science ®Google Scholar
• Larsson, S. (2009). A pluralist view of generalization in qualitative research. International Journal of Research & Method in Education, 32(1), 25–38. https://doi.org/10.1080/17437270902759931
   Google Scholar
• Lucas, W. A. (1974). The case survey method: Aggregating case experience. Santa Monica.
   Google Scholar
• Markard, J., Raven, R., & Truffer, B. (2012). Sustainability transitions: An emerging field of research and its prospects. Research Policy, 41(6), 955–967. https://doi.org/10.1016/j.respol.2012.02.013
   Web of Science ®Google Scholar
• McLean, I., & McMillan, A. (2009). The concise Oxford dictionary of politics. Oxford University Press.
   Google Scholar
• Merton, R. K. (1957). Priorities in scientific discovery: A chapter in the sociology of science. American Sociological Review, 22(6), 635–659. https://doi.org/10.2307/2089193
   Web of Science ®Google Scholar
• Moher, D., Liberati, A., Tetzlaff, J., Altman, D. J., & The PRISMA Group. (2009). Preferred reporting items for systematic reveiws and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097
   PubMed Web of Science ®Google Scholar
• Newig, J., Adzersen, A., Challies, E., Fritsch, O., & Jager, N. (2013). Comparative analysis of public environmental decision-making processes: a variable-based analytical scheme (INFU Discussion Paper No. 37/13). Vol. 37/13 (Lüneburg).
   Google Scholar
• Newig, J., & Fritsch, O. (2009a). The case survey method and applications in political science. APSA 2009 Paper. http://ssrn.com/abstract=1451643 (Toronto)
   Google Scholar
• Newig, J., & Fritsch, O. (2009b). Environmental governance: Participatory, multi-level – And effective? Environmental Policy and Governance, 19(3), 197–214. https://doi.org/10.1002/eet.509
   Google Scholar
• Newig, J., Jager, N. W., Kochskämper, E., & Challies, E. (2019). Learning in participatory environmental governance – its antecedents and effects. Findings from a case survey meta-analysis. Journal of Environmental Policy & Planning, 21(3), 213–227. https://doi.org/10.1080/1523908X.2019.1623663
   Web of Science ®Google Scholar
• Newig, J., Kochskämper, E., Challies, E., & Jager, N. W. (2016). Exploring governance learning: How policymakers draw on evidence, experience and intuition in designing participatory flood risk planning. Environmental Science & Policy, 55(January 01), 353–360. https://doi.org/10.1016/j.envsci.2015.07.020
   PubMedGoogle Scholar
• Newig, J., & Koontz, T. M. (2014). Multi-level governance, policy implementation and participation: The EU's mandated participatory planning approach to implementing environmental policy. Journal of European Public Policy, 21(2), 248–267. https://doi.org/10.1080/13501763.2013.834070
   Web of Science ®Google Scholar
• Nutley, S., Boaz, A., Davies, H., & Fraser, A. (2019). New development: What works now? Continuity and change in the use of evidence to improve public policy and service delivery. Public Money and Management, 39(4), 310–316. https://doi.org/10.1080/09540962.2019.1598202
   Web of Science ®Google Scholar
• Ostrom, E. (1990). Governing the commons. The evolution of institutions for collective action, political economy of institutions and decisions. Cambridge University Press.
   Google Scholar
• Ostrom, E. (2009). A general framework for analyzing sustainabiltiy of social-ecological systems. Science, 325(5939), 419–422. https://doi.org/10.1126/science.1172133
   PubMed Web of Science ®Google Scholar
• Parkhurst, J. (2017). The politics of evidence: From evidence-based policy to the good governance of evidence., Routledge studies in governance and public policy. Routledge.
   Google Scholar
• Pauliuk, S. (2019). Making sustainability science a cumulative effort. Nature Sustainability, 1–3. https://doi.org/10.1038/s41893-019-0443-7
   Web of Science ®Google Scholar
• Pawson, R. (2006). Evidence-based policy: A realist perspective. Sage.
   Google Scholar
• Pawson, R. (2013). The science of evaluation: A realist manifesto. SAGE Publications.
   Google Scholar
• Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005). Realist review – a new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy, 10(1), 21–34. https://doi.org/10.1258/1355819054308530
   PubMedGoogle Scholar
• Pawson, R., & Tilley, N. (1997). Realistic evaluation. Sage.
   Google Scholar
• Payne, G., & Williams, M. (2005). Generalization in qualitative research. Sociology, 39(2), 295–314. https://doi.org/10.1177/0038038505050540.
   Google Scholar
• Plummer, R., Armitage, D. R., & de Loë, R. C. (2013). Adaptive comanagement and its relationship to environmental governance. Ecology and Society, 18, 1. https://doi.org/10.5751/ES-05383-180121
   Web of Science ®Google Scholar
• Quilley, S., & Loyal, S. (2005). Eliasian sociology as a ‘central theory’ for the human sciences. Current Sociology, 53(5), 807–828. https://doi.org/10.1177/0011392105055021
   Google Scholar
• Ragin, C. C. (2000). Fuzzy-set social science. University of Chicago Press.
   Google Scholar
• Raven, R. (2012). Analyzing emerging sustainable energy Niches in Europe: A strategic niche management perspective. In G. Verbong & D. Loorbach (Eds.), Governing the energy transition. Reality, illusion or necessity (pp. 125–151). Routledge.
   Google Scholar
• Reed, M. G., & Bruyneel, S. (2010). Rescaling environmental governance, rethinking the state: A three-dimensional review. Progress in Human Geography, 34(5), 646–653. https://doi.org/10.1177/0309132509354836
   Web of Science ®Google Scholar
• Reed, M. S., Evely, A. C., Cundill, G., Fazey, I., Glass, J., Laing, A., Newig, J., Parrish, B., Prell, C., Raymond, C., & Stringer, L. C. (2010). What is social learning? Ecology and Society, 15(2).
   Google Scholar
• Reed, M., & Meagher, L. (2019). Using evidence in environmental and sustainability issues. In A. Boaz, H. Davies, A. Fraser, & S. Nutley (Eds.), What works now? Evidence-informed policy and practice (pp. 151–170). Policy Press.
   Google Scholar
• Rhodes, R. A. W. (1997). Understanding governance. Policy networks, governance, reflexivity and accountability. Open University Press.
   Google Scholar
• Rose, M. (2020). Macro-level datasets for sustainability governance. In Sustainability Governance (Blog), available online: https://sustainability-governance.net/2020/01/17/macro-level-datasets-for-sustainability-governance
   Google Scholar
• Sanderson, I. (2002). Evaluation, policy learning and evidence-based policy making. Public Administration, 80(1), 1–22. https://doi.org/10.1111/1467-9299.00292
   Web of Science ®Google Scholar
• Saunier, R. E., & Meganck, R. A. (2009). Dictionary and introduction to global environmental governance (2nd, fully revised and updated ed.). Earthscan.
   Google Scholar
• Schneider, C. Q., & Wagemann, C. (2012). Set-theoretic methods for the social sciences: A guide to qualitative comparative analysis. Cambridge University Press.
   Google Scholar
• Scott, T. (2015). Does collaboration make any difference? Linking collaborative governance to environmental outcomes. Journal of Policy Analysis and Management, 34(3), 537–566. https://doi.org/10.1002/pam.21836
   PubMed Web of Science ®Google Scholar
• Smith, A., Voß, J.-P., & Grin, J. (2010). Innovation studies and sustainability transitions: The allure of the multi-level perspective and its challenges. Research Policy, 39(4), 435–448. https://doi.org/10.1016/j.respol.2010.01.023
   Web of Science ®Google Scholar
• Stringer, L. C., Dougill, A. J., Fraser, E. D. G., Hubacek, K., Prell, C., & Reed, M. S. (2006). Unpacking “participation” in the adaptive management of social-ecological systems: A critical review. Ecology and Society, 11(2), 2. https://doi.org/10.5751/ES-01896-110239
   Web of Science ®Google Scholar
• Tacconi, L. (2011). Developing environmental governance research: The example of forest cover change studies. Environmental Conservation, 38(2), 234–246. https://doi.org/10.1017/S0376892911000233
   Web of Science ®Google Scholar
• van der Heijden, J. (2015). What ‘works’ in environmental policy-design? Lessons from experiments in the Australian and Dutch building sectors. Journal of Environmental Policy & Planning, 17(1), 44–64. https://doi.org/10.1080/1523908X.2014.886504
   Web of Science ®Google Scholar
• van der Heijden, J., & Kuhlmann, J. (2017). Studying incremental institutional change: A systematic and critical meta-review of the literature from 2005 to 2015. Policy Studies Journal, 45(3), 535–554. https://doi.org/10.1111/psj.12191
   Web of Science ®Google Scholar
• van der Heijden, J., & Kuhlmann, J. (2018). Assessing policy process knowledge: A systematic review of three theoretical approaches that are applied to cases of policy change. European Policy Analysis, 4(1), 72–93. https://doi.org/10.1002/epa2.1035
   Google Scholar
• van der Heijden, J., Kuhlmann, J., Lindquist, E., & Wellstead, A. (2019). Have policy process scholars embraced causal mechanisms? A review of five popular frameworks. Public Policy and Administration, 1–24. https://doi.org/10.1177/0952076718814894
   Web of Science ®Google Scholar
• van der Hel, S., & Biermann, F. (2017). The authority of science in sustainability governance: A structured comparison of six science institutions engaged with the sustainable development goals. Environmental Science and Policy, 77, 211–220. https://doi.org/10.1016/j.envsci.2017.03.008
   Web of Science ®Google Scholar
• Visseren-Hamakers, I. J. (2015). Integrative environmental governance: Enhancing governance in the era of synergies. Current Opinion in Environmental Sustainability, 14, 136–143. https://doi.org/10.1016/j.cosust.2015.05.008
   Web of Science ®Google Scholar
• Weiss, T. G. (2000). Governance, good governance and global governance: Conceptual and actual challenges. Third World Quarterly, 21(5), 795–814. https://doi.org/10.1080/713701075
   Web of Science ®Google Scholar
• Whitley, R. (2006). The intellectual and social organization of the sciences (2nd repr ed.). Oxford University Press.
   Google Scholar
• Yin, R. K., & Heald, K. A. (1975). Using the case survey method to analyze policy studies. Administrative Science Quarterly, 20(3), 371–381. https://doi.org/10.2307/2391997
   Web of Science ®Google Scholar
• Zelli, F., Möller, I., & van Asselt, H. (2017). Institutional complexity and private authority in global climate governance: The cases of climate engineering, REDD+ and short-lived climate pollutants. Environmental Politics, 26(4), 669–693. https://doi.org/10.1080/09644016.2017.1319020
   Web of Science ®Google Scholar