Assessing Collaborative Conservation: A Case Survey of Output, Outcome, and Impact Measures Used in the Empirical Literature

References

• Ansell, C., and A. Gash. 2008. Collaborative governance in theory and practice. Journal of Public Administration Research and Theory 18(4):543–571.
   Google Scholar
• Anderson, L. M., M. Petticrew, E. Rehfuess, R. Armstrong, E. Ueffing, P. Baker, D. Francis, and P. Tugwell. 2011. Using logic models to capture complexity in systematic reviews. Research Synthesis Methods 2(1):33–42. doi: 10.1002/jrsm.32.
   PubMed Web of Science ®Google Scholar
• Baylis, K., J. Honey‐Rosés, J. Börner, E. Corbera, D. Ezzine de Blas, P. J. Ferraro, R. Lapeyre, U. M. Persson, et al. 2016. Mainstreaming impact evaluation in nature conservation. Conservation Letters 9(1):58–64. doi: 10.1111/conl.12180.
   Web of Science ®Google Scholar
• Bennett, N. J., R. Roth, S. C. Klain, K. M. Chan, D. A. Clark, B. Cullman, G. Epstein, M. P. Nelson, R. Stedman, T. Teel, et al. 2017. Mainstreaming the social sciences in conservation. Conservation Biology 31(1):56–66. doi: 10.1111/cobi.12788.
   PubMed Web of Science ®Google Scholar
• Biddle, J. C., and T. M. Koontz. 2014. Goal specificity: A proxy measure for improvements in environmental outcomes in collaborative governance. Journal of Environmental Management 145:268–76. doi: 10.1016/j.jenvman.2014.06.029.
   PubMed Web of Science ®Google Scholar
• Bidwell, R. D., and C. M. Ryan. 2006. Collaborative partnership design: the implications of organizational affiliation for watershed partnerships. Society and Natural Resources 19(9):827–43. doi: 10.1080/08941920600835585.
   Web of Science ®Google Scholar
• Börner, J., K. Baylis, E. Corbera, D. Ezzine-de-Blas, P. J. Ferraro, J. Honey-Rosés, R. Lapeyre, U. M. Persson, and S. Wunder. 2016. Emerging evidence on the effectiveness of tropical Forest conservation. PLoS One 11(11):e0159152. doi: 10.1371/journal.pone.0159152.
   PubMed Web of Science ®Google Scholar
• Carr, D. S., S. W. Selin, and M. A. Schuett. 1998. Managing public forests: understanding the role of collaborative planning. Environmental Management 22(5):767–76. doi: 10.1007/s002679900146.
   PubMed Web of Science ®Google Scholar
• Conley, A., and M. A. Moote. 2003. Evaluating collaborative natural resource management. Society and Natural Resources 16(5):371–86. doi: 10.1080/08941920309181.
   Web of Science ®Google Scholar
• Craig, P., P. Dieppe, S. Macintyre, S. Michie, I. Nazareth, and M. Petticrew. 2008. Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ 337:a1655.
   PubMed Web of Science ®Google Scholar
• de Snoo, G. R., I. Herzon, H. Staats, R. J. F. Burton, S. Schindler, J. van Dijk, A. Marike Lokhorst, J. M. Bullock, M. Lobley, T. Wrbka, et al. 2013. Toward effective nature conservation on farmland: making farmers matter. Conservation Letters 6(1):66–72. doi: 10.1111/j.1755-263X.2012.00296.x.
   Web of Science ®Google Scholar
• Emerson, K., T. Nabatchi, and S. Balogh. 2012. An integrative framework for collaborative governance. Journal of Public Administration Research and Theory 22(1):1–29.
   Google Scholar
• Ferraro, P. J., and S. K. Pattanayak. 2006. Money for nothing? A call for empirical evaluation of biodiversity conservation investments. PLoS Biology 4(4):e105. doi: 10.1371/journal.pbio.0040105.
   PubMed Web of Science ®Google Scholar
• Genskow, K. D. 2009. Catalyzing collaboration: Wisconsin’s agency-initiated basin partnerships. Environmental Management 43(3):411–24. doi: 10.1007/s00267-008-9236-x.
   PubMed Web of Science ®Google Scholar
• George, A. L, and A. Bennett. 2005. Case studies and theory development in the social sciences. Cambridge, MA: MIT Press.
   Google Scholar
• Glasgow, R. E., T. M. Vogt, and S. M. Boles. 1999. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. American Journal of Public Health 89(9):1322–7. doi: 10.2105/AJPH.89.9.1322.
   PubMed Web of Science ®Google Scholar
• Hardy, S.D. and T.M. Koontz. 2008. Reducing nonpoint source pollution through collaboration: Policies and programs across the U.S. States. Environmental Management 41(3):301–310.
   Google Scholar
• Grumbine, R. E. 1994. What is ecosystem management?. Conservation Biology 8(1):27–38. doi: 10.1046/j.1523-1739.1994.08010027.x.
   Web of Science ®Google Scholar
• Innes, J., and D. Booher. 2010. Planning with complexity: An introduction to collaborative rationality for public policy. New York: Routledge
   Google Scholar
• James, L. R., R. G. Demaree, and G. Wolf. 1984. Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology 69(1):85–98. doi: 10.1037/0021-9010.69.1.85.
   Web of Science ®Google Scholar
• Jensen, J. L., and R. Rodgers. 2001. Cumulating the intellectual gold of case study research. Public Administration Review 61(2):235–46. doi: 10.1111/0033-3352.00025.
   Web of Science ®Google Scholar
• Koebele, E. A. 2015. Assessing outputs, outcomes, and barriers in collaborative water governance: A case study. Journal of Contemporary Water Research & Education 155(1): 63–72.
   Google Scholar
• Kaplan, S. A., and K. E. Garrett. 2005. The use of logic models by community-based initiatives. Evaluation and Program Planning 28(2):167–72. doi: 10.1016/j.evalprogplan.2004.09.002.
   Web of Science ®Google Scholar
• Koontz, T.M., and C. Thomas. 2018. Use of science in collaborative environmental management: Evidence from local watershed partnerships in the Puget Sound. Environmental Science and Policy 88:17–23.
   Google Scholar
• Koontz, T. M. 2016. Back to the future? Collaborative environmental governance theory and practice, In The challenges of collaboration in environmental governance: Barriers and responses. eds. R. D. Margerum and C. Robinson, pp. 54–80. Northampton, MA: Edward Elgar Publishing.
   Google Scholar
• Koontz, T.M., and J. Newig. 2014. From planning to implementation: Top down and bottom up approaches for collaborative watershed management. Policy Studies Journal 42(3):416–442.
   Google Scholar
• Koontz, T. M., and C. W. Thomas. 2006. What do we know and need to know about the environmental outcomes of collaborative management?. Public Administration Review 66 (s1):111–21. doi: 10.1111/j.1540-6210.2006.00671.x.
   Web of Science ®Google Scholar
• Koontz, T. M., T. A. Steelman, J. Carmin, K. S. Korfmacher, C. Moseley, and C. W. Thomas. 2004. Collaborative environmental management: What roles for government?. Washington, DC: Resources for the Future Press.
   Google Scholar
• Layzer, J. A. 2002. Citizen participation and government choice in local environmental controversies. Policy Studies Journal 30(2):193–207. doi: 10.1111/j.1541-0072.2002.tb02141.x.
   Google Scholar
• Mandarano, L. A. 2008. Evaluating collaborative environmental planning outputs and outcomes: Restoring and protecting habitat and the New York-New Jersey harbor estuary program. Journal of Planning Education and Research 27(4):456–68. doi: 10.1177/0739456X08315888.
   Web of Science ®Google Scholar
• Margerum, R. D. 2011. Beyond consensus: Improving collaborative planning and management. Cambridge, MA: MIT Press.
   Google Scholar
• Marston, E. 2001. The Quincy Library Group: A divisive attempt at peace. In Across the great divide: Explorations in collaborative conservation and the American West. eds. P. Brick, D. Snow, and S. van de Wetering, pp. 79–90. Washington, DC: Island Press.
   Google Scholar
• Millennium Ecosystem Assessment (MEA) 2005. Ecosystems and human well-being: Policy responses: Findings of the responses Working Group of the Millennium Ecosystem Assessment. Washington, D.C: Island Press.
   Google Scholar
• Moss, T. 2004. The governance of land use in river basins: prospects for overcoming problems of institutional interplay with the EU water framework directive. Land Use Policy 21(1):85–94. doi: 10.1016/j.landusepol.2003.10.001.
   Web of Science ®Google Scholar
• Muro, M., and P. Jeffrey. 2008. A critical review of the theory and application of social learning in participatory natural resource management processes. Journal of Environmental Planning and Management 51(3):325–44. doi: 10.1080/09640560801977190.
   Web of Science ®Google Scholar
• Newig, J., A. Adzersen, E. Challies, O. Fritsch, and N. Jager. 2013. Comparative analysis of public environmental decision-making processes: A variable-based analytical scheme. Discussion paper. Vol. 37. Luneburg Germany: Leuphana University.
   Google Scholar
• Newig, J., and T. M. Koontz. 2014. Multi-level governance, policy implementation, and participation: The EU’s mandated participatory planning approach to implementing environmental policy. Journal of European Public Policy 21(2):248–67. doi: 10.1080/13501763.2013.834070.
   Web of Science ®Google Scholar
• Newig, J., E. Challies, N. W. Jager, E. Kochskaemper, and A. Adzersen. 2018. The environmental performance of participatory and collaborative governance: A framework of causal mechanisms. Policy Studies Journal 46(2):269–97. http://doi.wiley.com/10.1111/psj.12209 doi: 10.1111/psj.12209.
   PubMed Web of Science ®Google Scholar
• Ohio Forestry Association 1955. How to develop watersheds. Columbus, Ohio.
   Google Scholar
• Olson, E. A. 2002. Water management and the Upper Clark Fork Steering Committee. In Finding common ground: Governance and natural resources in the American West. eds. R. D. Brunner, C. H. Colburn, C. M. Cromley, R. A. Klein, and E. A. Olson, pp. 48–87. New Haven, CT: Yale University Press.
   Google Scholar
• O'Riordan, J. 1976. The public involvement program in the Okanagan basin study. Natural Resources 16:177–96.
   Web of Science ®Google Scholar
• Poteete, A. R., M. A. Janssen, and E. Ostrom. 2010. Working together: collective action, the commons, and multiple methods in practice. Princeton, NJ: Princeton University Press.
   Google Scholar
• Sabatier, P.A., C. Weible, and J. Ficker. 2005. Eras of water management in the United States: Implications for collaborative watershed approaches, In Swimming upstream: Collaborative approaches to watershed management. eds. P.A. Sabatier, W. Focht, M. Lubell, Z. Trachtenberg, A. Vedlitz, and M. Matlock, pp. 23–52. Cambridge, MA: MIT Press.
   Google Scholar
• Sabatier, P. A., W. Focht, M. Lubell, Z. Trachtenberg, A. Vedlitz, and M. Matlock (eds.) 2005. Swimming upstream: collaborative approaches to watershed management. Cambridge, MA: MIT Press.
   Google Scholar
• Sandbrook, C., W. M. Adams, B. Buscher, and B. Vira. 2013. Social research and biodiversity conservation. Conservation Biology 27(6):1487–90. doi: 10.1111/cobi.12141.
   PubMed Web of Science ®Google Scholar
• Scott, T. 2015. Does collaboration make any difference? Linking collaborative governance to environmental outcomes. Journal of Policy Analysis and Management 34(3):537–66. doi: 10.1002/pam.21836.
   PubMed Web of Science ®Google Scholar
• Sharma, T., M. Choudhury, B. Kaur, B. Naidoo, S. Garner, P. Littlejohns, and S. Staniszewska. 2015. Evidence informed decision making: the use of “colloquial evidence” at NICE. International Journal of Technology Assessment in Health Care 31(3):138–46. doi: 10.1017/S0266462314000749.
   PubMed Web of Science ®Google Scholar
• Snow, D. 2001. Coming home: An introduction to collaborative conservation. In Across the great divide: Explorations in collaborative conservation and the American West. eds. P. Brick, D. Snow, and S. van de Wetering, pp. 1–11. Washington, DC: Island Press.
   Google Scholar
• Stedman, R., B. Lee, K. Brasier, J. L. Weigle, and F. Higdon. 2009. Cleaning up water? Or building rural community? Community watershed organizations in Pennsylvania. Rural Sociology 74(2):178–200. doi: 10.1111/j.1549-0831.2009.tb00388.x.
   Web of Science ®Google Scholar
• Stenberg, C. W. 1972. Citizens and the administrative state: From participation to power. Public Administration Review 32(3):190–7. doi: 10.2307/975270.
   Web of Science ®Google Scholar
• Thomas, C. W. 2003. Bureaucratic landscapes: Interagency cooperation and the preservation of biodiversity. Cambridge, MA: MIT Press.
   Google Scholar
• Thomas, C. W., and T. M. Koontz. 2011. Research designs for examining the impact of community-based management on natural resource conservation. Journal of Natural Resources Policy Research 3(2):97–111. doi: 10.1080/19390459.2011.557877.
   Google Scholar
• Ulibarri, N. 2015. Tracing process to performance of collaborative governance: A comparative case study of federal hydropower licensing. Policy Studies Journal 43(2):283–308. doi: 10.1111/psj.12096.
   Web of Science ®Google Scholar
• Widaman, K. F. 2007. Common factors versus components: Principals and principles, errors and misconception. In Factor analysis and future directions, eds. R. Cudeck and R.C. MacCallum, Mahwah, NJ: Erlbaum.
   Google Scholar
• Wondolleck, J. M., and S. L. Yaffee. 2000. Making collaboration work: Lessons from innovation in natural resource management. Washington, DC: Island Press.
   Google Scholar