The challenges in integrating horizontal perspectives in sectoral policy evaluation

References

• Anderson, S., K. Berglund, E. Gunnarsson, and E. Sundin. 2012. Promoting Innovation – Policies, Practices and Procedures, VINNOVA REPORT VR 2012:8. Stockholm: VINNOVA.
   Google Scholar
• Archibald, T. 2020. “Whats the Problem Represented to be? Problem Definition Critique as a Tool for Evaluative Thinking.” American Journal of Evaluation 41 (1): 6–19.
   Web of Science ®Google Scholar
• Azzam, T. 2010. “Evaluator Responsiveness to Stakeholders.” American Journal of Evaluation 31 (1): 45–65.
   Web of Science ®Google Scholar
• Bacchi, C. L. 1999. Women, Policy and Politics: The Construction of Policy Problems. London: Sage.
   Google Scholar
• Benschop, Y., and M. Verloo. 2006. “Sisyphus’ Sisters: Can Gender Mainstreaming Escape the Genderedness of Organizations?” Journal of Gender Studies 15 (1): 19–33.
   Web of Science ®Google Scholar
• Beveridge, F., E. Lombardo, and M. Forest. 2012. “‘Going Soft’? Analysing the Contribution of Soft and Hard Measures in EU Gender law and Policy.” In The Europeanization of Gender Equality Policies: A Discursive-Sociological Approach, edited by E. Lombardo and Forest, M. 28–46. London, UK: Palgrave Macmillan.
   Google Scholar
• Bouckaert, G., G. B. Peters, and K. Verhoest. 2010. The Coordination of Public Sector Organizations: Shifting Patterns of Public Management. Hampshire: Palgrave Macmillan.
   Google Scholar
• Bovens, M., P. ‘t Hart, and S. Kuipers. 2006. “The Politics of Policy Evaluation.” In The Oxford Handbook of Public Policy, edited by M. Moran, M. Rein, and R. E. Goodin, 319–335. Oxford: Oxford University Press.
   Google Scholar
• Brodkin, E. Z. 1990. “Implementation as Policy Politics.” In 1990. Implementation and the Policy Process: Opening up the Black Box, edited by D. J. Palumbo and D. J. Calista, 107–118. New York: Greenwood Press.
   Google Scholar
• Callerstig, A.-C. 2014. “Making Equality Work: Ambiguities, Conflicts and Change Agents in the Implementation of Equality Policies in Public Sector Organisations.” PhD diss., Linköping University Press, Linköping.
   Google Scholar
• Candel, J. J. L. 2017. “Holy Grail or Inflated Expectations? The Success and Failure of Integrated Policy Strategies.” Policy Studies 38 (6): 519–552.
   Web of Science ®Google Scholar
• Candel, J. J. L. 2019. “The Expediency of Policy Integration.” Policy Studies 42 (4): 346–361. doi:10.1080/01442872.2019.1634191.
   Web of Science ®Google Scholar
• Candel, J. J. L., and R. Biesbroek. 2016. “Toward a Processual Understanding of Policy Integration.” Policy Sciences 49 (3): 211–231.
   Web of Science ®Google Scholar
• Chelimsky, E. 2007. “Factors Influencing the Choice of Methods in Federal Evaluation Practice.” New Directions for Evaluation 2007: 13–33.
   Google Scholar
• Chelimsky, E. 2009. “Integrating Evaluation Units Into the Political Environment of Government: The Role of Evaluation Policy.” New Directions for Evaluation 2009: 51–66.
   Google Scholar
• Christensen, T., L. A. Fimreite, and P. Lægreid. 2007. “Reform of the Employment and Welfare Administrations the Challenges of co-Coordinating Diverse Public Organizations.” International Review of Administrative Sciences 73 (3): 389–408.
   Web of Science ®Google Scholar
• Christensen, T., and P. Lægreid. 2007. “The Whole-of-Government Approach to Public Sector Reform.” Public Administration Review 67 (6): 1059–1066.
   Web of Science ®Google Scholar
• Christensen, T., P. Lægreid, and L. R. Wise. 2003. “Evaluating Public Management Reforms in Central Government: Norway, Sweden and the United States of America.” In Evaluation in Public Sector Reform: Concepts and Practice in International Perspective, edited by H. Wollman, 56–79. Cheltenham: Edward Elgar.
   Google Scholar
• Christie, C. A., P. Quinones, and L. Fiero. 2014. “Informing the Discussion on Evaluator Training: A Look at Evaluators’ Course Taking and Professional Practice.” American Journal of Evaluation 35 (2): 274–290.
   Web of Science ®Google Scholar
• Connell, R. 2006. “The Experience of Gender Change in Public Sector Organizations.” Gender, Work and Organization 13 (5): 435–452.
   Web of Science ®Google Scholar
• Cousins, J. B. 2003. “Utilization Effects of Participatory Evaluation.” In International Handbook of Educational Evaluation, edited by T. Kelleghan and D. L. Stufflebeam, 245–265. Dordrecht: Kluwer Academic.
   Google Scholar
• Cousins, J. B., S. C. Goh, S. Clark, and L. E. Lee. 2004. “Integrating Evaluative Inquiry Into the Organizational Culture: A Review and Synthesis of the Knowledge Base.” Canadian Journal of Program Evaluation 19 (2): 99–141.
   Google Scholar
• Council of Europe. 1998. “Gender Mainstreaming: Conceptual Framework, Methodology and Presentation of Good Practices.” Council of Europe. EG-S-MS (98) 2 rev.
   Google Scholar
• Drimie, S., and S. Ruysenaar. 2010. “The Integrated Food Security Strategy of South Africa: An Institutional Analysis.” Agrekon: Agricultural Economics Research, Policy and Practice in Southern Africa 49 (3): 316–337.
   Google Scholar
• Donaldson, S. I., and M. W. Lipsey. 2008. “Roles for Theory in Contemporary Evaluation Practice: Developing Practical Knowledge.” In The Handbook of Evaluation: Policies, Programs, and Practices, edited by I. Shaw, J. Greene, and M. Mark, 56–75. London: Sage.
   Google Scholar
• Eikeland, O. 2006. “Condescending Ethics and Action Research.” Action Research 4 (1): 37–47.
   Google Scholar
• Fitzpatrick, J. L. 2004. “Exemplars as Case Studies: Reflections on the Link Between Theory, Practice and Context.” American Journal of Evaluation 25 (4): 541–559.
   Web of Science ®Google Scholar
• Gioia, D. A., K. G. Corley, and A. L. Hamilton. 2013. “Seeking Qualitative Rigor in Inductive Research: Notes on the Gioia Methodology.” Organizational Research Methods 16 (1): 15–31.
   Web of Science ®Google Scholar
• Goode, W. J. 1960. “A Theory of Role Strain.” American Sociological Review 25 (4): 483–496.
   Web of Science ®Google Scholar
• Govt. Bill 1993/94. 147 Gender Equality Policy: Shared Power—Shared Responsibility. (Prop. 1993/94:147). Jämställdhetspolitiken: delad makt – delat ansvar.
   Google Scholar
• Gunnarsson, E. 2006. “The Snake and the Apple in the Common Paradise.” In Action Research and Interactive Research. Beyond Practice and Theory, edited by K. Aagard Nielsen and L. Svensson, 117–143. Maastricht: Shaker Publishing.
   Google Scholar
• Hearn, J., and L. McKie. 2008. “Gendered Policy and Policy on Gender: The Case of ‘Domestic Violence.’” Policy & Politics 36 (1): 75–91.
   Web of Science ®Google Scholar
• Hertin, J., and F. Berkhout. 2003. “Analysing Institutional Strategies for Environmental Policy Integration: The Case of EU Enterprise Policy.” Journal of Environmental Policy and Planning 5 (1): 39–56.
   Google Scholar
• Hill, M., and P. Hupe. 2009. Implementing Public Policy. London: SAGE publications.
   Google Scholar
• Hood, C. 1991. “A Public Management for all Seasons?” Public Administration 69 (1): 3–19.
   Web of Science ®Google Scholar
• Howlett, M. 2009. “Policy Analytical Capacity and Evidence-Based Policy-Making: Lessons from Canada.” Canadian Public Administration 52 (2): 153–175.
   Web of Science ®Google Scholar
• Howlett, M. 2014. “Why Are Policy Innovations Rare and so Often Negative? Blame Avoidance and Problem Denial in Climate Change Policy-Making.” Global Environmental Change 29: 395–403.
   Web of Science ®Google Scholar
• Howlett, M., and K. Saguin. 2018. “Policy Capacity for Policy Integration: Implications for the Sustainable Development Goals.” Working paper, Lee Kuan Yew School of Public Policy Research Paper No. 18-06.
   Google Scholar
• Jacob, S., S. Speer, and J.-E. Furubo. 2015. “The Institutionalization of Evaluation Matters: Updating the International Atlas of Evaluation 10 Years Later.” Evaluation 21 (1): 6–31.
   Web of Science ®Google Scholar
• Jacob, K., A. Volkery, and A. Lenschow. 2008. “Instruments for Environmental Policy Integration in 30OECD Countries.” In Innovation in Environmental Policy? Integrating the Environment for Sustainability, edited by A. Jordan and A. Lenschow, 24–48. Cheltenham, UK: Edward Elgar.
   Google Scholar
• Jahan, R. 1995. The Elusive Agenda: Mainstreaming Women in Development. London: Zed Books.
   Google Scholar
• Jochim, A. E., and P. J. May. 2010. “Beyond Subsystems: Policy Regimes and Governance.” Policy Studies Journal 38 (2): 303–327.
   Web of Science ®Google Scholar
• Jordan, A., and A. Lenschow. 2010. “Policy Paper Environmental Policy Integration: A State of the art Review.” Environmental Policy and Governance 20 (3): 147–158.
   Web of Science ®Google Scholar
• King, J. A., and L. Stevahn. 2015. “Competencies for Program Evaluators in Light of Adaptive Action: What? So What?” Now What? New Directions for Evaluation 2015: 21–37.
   Google Scholar
• King, J. A., L. Stevahn, G. Ghere, and J. Minnema. 2001. “Toward a Taxonomy of Essential Evaluator Competencies.” American Journal of Evaluation 22 (2): 229–247.
   Web of Science ®Google Scholar
• Kivimaa, P., and P. Mickwitz. 2006. “The Challenge of Greening Technologies – Environmental Policy Integration in Finnish Technology Policies.” Research Policy 35 (5): 729–744.
   Web of Science ®Google Scholar
• Lafferty, W., and E. Hovden. 2003. “Environmental Policy Integration: Towards an Analytical Framework.” Environmental Politics 12 (3): 1–22.
   Web of Science ®Google Scholar
• LaVelle, J. M., and S. I. Donaldson. 2010. “University-based Evaluation Training Programs in the United States 1980-2008: An Empirical Examination.” American Journal of Evaluation 31 (1): 9–23.
   Web of Science ®Google Scholar
• Lombardo, E. 2005. “Integrating or Setting the Agenda? Gender Mainstreaming in the European Constitution-Making Process.” Social Politics: International Studies in Gender, State & Society 12 (3): 412–432.
   Google Scholar
• Lombardo, E., P. Meier, and M. Verloo. 2009. The Discursive Politics of Gender Equality. Stretching, Bending and Policymaking. London: Routledge.
   Google Scholar
• Lundine, J., I. L. Bourgeault, K. Glonti, E. Hutchinson, and D. Balabanova. 2019. ““I Don't see Gender”: Conceptualizing a Gendered System of Academic Publishing.” Social Science & Medicine 235: 1–9.
   Web of Science ®Google Scholar
• Matland, R. E. 1995. “Synthesizing the Implementation Literature: The Ambiguity-Conflict Model of Policy Implementation.” Journal of Public Administration and Theory 5 (2): 145–174.
   Google Scholar
• May, P. J., J. Sapotichne, and S. Workman. 2006. “Policy Coherence and Policy Domains.” Policy Studies Journal 34 (3): 381–403.
   Web of Science ®Google Scholar
• Meier, P. 2006. “Implementing Gender Equality: Gender Mainstreaming or the Gap Between Theory and Practice.” In Women's Citizenship Rights and Political Rights, edited by S. K. Hellsten, H. A. Maria, and K. Daskalova, 179–198. Basingstoke: Palgrave Macmillan.
   Google Scholar
• Mickwitz, P., and P. Kivimaa. 2007. “Evaluating Policy Integration: The Case of Policies for Environmentally Friendlier Technological Innovations.” Evaluation 13 (1): 68–86.
   Google Scholar
• Moret-Hartman, M., R. Reuzel, J. Grin, C. Kramers, and G. J. Van der Wilt. 2011. “Strengthening Evaluation Through Interactive Problem Structuring: A Case Study of Hospital Care After Attempted Suicide.” Evaluation 17: 37–52.
   Google Scholar
• Nilsson, M. 2005. “Learning, Frames, and Environmental Policy Integration: The Case of Swedish Energy Policy.” Environment and Planning C: Government and Policy 23 (2): 207–226.
   Web of Science ®Google Scholar
• Nielsen, K. A., and L. Svensson. (Eds). 2006. Action Research and Interactive Research. Beyond Practice and Theory. Maastricht: Shaker Publishing.
   Google Scholar
• Nilsson, M., T. Zamparutti, J. E. Petersen, B. Nykvist, P. Rudberg, and J. McGuinn. 2012. “Understanding Policy Coherence: Analytical Framework and Examples of Sector Environment Policy Interactions in the EU.” Environmental Policy and Governance 22 (6): 395–423.
   Web of Science ®Google Scholar
• O’Sullivan, R. G. 2004. Practicing Evaluation: A Collaborative Approach. Thousand Oaks, CA: Sage.
   Google Scholar
• Palmén, R., L. Arroyo, J. Müller, S. Reidl, M. Caprile, and M. Unger. 2020. “Integrating the Gender Dimension in Teaching, Research Content & Knowledge and Technology Transfer: Validating the EFFORTI Evaluation Framework Through Three Case Studies in Europe.” Evaluation and Program Planning 79 (April 2020): 1-10. 101751.
   Google Scholar
• Pearse, R., J. N. Hitchcock, and H. Keane. 2019. “Gender Inter/Disciplinarity and Marginality in the Social Science and Humanities: A Comparison of six Disciplines.” Women’s Studies International Forum 72 (Jan–Feb): 109–126.
   Web of Science ®Google Scholar
• Peters, G. B. 2018. “The Challenge of Policy Coordination.” Policy Design and Practice 1 (1): 1–11.
   Google Scholar
• Podems, D. R. 2010. “Feminist Evaluation and Gender Approaches: There’s a Difference?” Journal of MultiDisciplinary Evaluation 6 (14): 1–17.
   Google Scholar
• Pollack, M. A., and E. M. Hafner-Burton. 2010. “Mainstreaming International Governance:The Environment, Gender, and IO Performance in the European Union.” The Review of International Organizations 5: 285–313.
   Web of Science ®Google Scholar
• Pollitt, C. 2003. “Joined-up Government: A Survey.” Political Studies Review 1 (1): 34–49.
   Google Scholar
• Pressman, J. L., and A. Wildavsky. 1984. Implementation. How Great Expectations in Washington Are Dashed in Oakland; Or, Why It's Amazing That Federal Programs Work at All. Berkeley: University of California Press.
   Google Scholar
• Rayner, J., and M. Howlett. 2009. “Introduction: Understanding Integrated Policy Strategies and Their Evolution.” Policy and Society 28 (2): 99–109.
   Google Scholar
• Rog, D. J., J. L. Fitzpatrick, and R. F. Conner. 2012. Context: A Framework for its Influence on Evaluation Practice. New Directions for Evaluation: No. 135. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Rönnblom, M. 2008. “De-politicising Gender? Constructions of Gender Equality in Swedish Regional Policy.” In Critical Studies of Gender Equalities: Nordic Dislocations, Dilemmas and Contradictions, edited by E. Magnusson, M. Rönnblom, and H. Silius, 112–134. Göteborg: Makadam Publishers.
   Google Scholar
• Saetren, H. 2005. “Facts and Myths About Research on Public Policy Implementation: out- of-Fashion, Allegedly Dead, but Still Very Much Alive and Relevant.” Policy Studies Journal 33 (4): 559–582.
   Web of Science ®Google Scholar
• Sainsbury, D., and C. Bergqvist. 2009. “The Promise and Pitfalls of Gender Mainstreaming.” International Feminist Journal of Politics 11 (2): 216–234.
   Web of Science ®Google Scholar
• Schofield, J. 2004. “A Model of Learned Implementation.” Public Administration 82 (2): 283–308.
   Web of Science ®Google Scholar
• Schwandt, T. 2007. “The Role of Practical Knowledge in Learning.” Paper delivered at the 21st annual conference of the American Evaluation Association, ‘learning to evaluate, evaluating to learn.’ Baltimore, 11/08/2007.
   Google Scholar
• Schwandt, T. 2015. Evaluation Foiundations Revisited: Cultivating a Life of the Mind for Practice. Stanford, CA: Stanford University Press.
   Google Scholar
• Shadish, W. R., and R. Epstein. 1987. “Patterns of Program Evaluation Practice among Members of the Evaluation Research Society and Evaluation Network.” Evaluation Review 11 (1): 555–590.
   Web of Science ®Google Scholar
• Shaw, J. 2002. “The European Union and Gender Mainstreaming: Constitutionally Embedded or Comprehensively Marginalised?” Feminist Legal Studies 10 (3): 213–226.
   Google Scholar
• Six, Perri, D. Leat, K. Seltzer, and G. Stoker. 1999. Governing in the Round. Strategies for Holistic Government. London: Demos.
   Google Scholar
• Squires, J. 2005. “Is Mainstreaming Transformative? Theorizing Mainstreaming in the Context of Diversity and Deliberation.” Social Politics: International Studies in Gender, State & Society 12 (3): 366–388.
   Google Scholar
• Stevahn, L., J. A. King, G. Ghere, and J. Minnema. 2005. “Evaluator Competencies in University-Based Evaluation Training Programs.” Canadian Journal of Program Evaluation 20 (2): 101–123.
   Google Scholar
• Sturges, K. M. 2014. “External Evaluation as Contract Work.” American Journal of Evaluation 35 (3): 346–363.
   Web of Science ®Google Scholar
• Tourmen, C. 2009. “Evaluators’ Decision Making: The Relationship Between Theory, Practice, and Experience.” American Journal of Evaluation 30 (1): 7–30.
   Web of Science ®Google Scholar
• van der Knapp, P. 2004. “Theory-based Evaluation and Learning: Possibilities and Challenges.” Evaluation 10 (1): 16–34.
   Google Scholar
• van Maanen, J., and S. Barley. 1984. “Occupational Communities: Culture and Control in Organizations.” In Research in Organizational Behaviour, edited by B. Straw and L. Cummings, 287–365. Greeneich, CT: JAI Press.
   Google Scholar
• Verhoest, K., and G. Bouckaert. 2005. “Machinery of Government and Policy Capacity: The Effects of Specialization and Coordination.” In Challenges to State Policy Capacity: Global Trends and Comparative Perspectives, edited by M. Painter and J. Pierre, 92–111. Basingstoke, UK: Palgrave MacMillan.
   Google Scholar
• Woolley, F. R. 1993. “The Feminist Challenge to Neoclassical Economics.” Cambridge Journal of Economics 17 (4): 485–500.
   Web of Science ®Google Scholar