References
- Allison, G. T., 1971, Essence of Decision: Explaining the Cuban Missile Crisis (Boston: Little, Brown).
- Andersen, S. C. and Jakobsen, M., 2017, Policy positions of Bureaucrats at the front lines: are they susceptible to strategic communication? Public Administration Review, 77(1), pp. 57–66. doi:https://doi.org/10.1111/puar.12584.
- Andersen, S. C. and Moynihan, D. P., 2016, Bureaucratic investments in expertise: evidence from a randomized controlled field trial. The Journal of Politics, 78(4), pp. 1032–1044. doi:https://doi.org/10.1086/686029.
- Angrist, J. D. and Pischke, J.-S., 2008, Mostly Harmless Econometrics: An Empiricist’s Companion (Princeton: Princeton University Press).
- Avellaneda, C. N., 2013, Mayoral decision-making: issue salience, decision context, and choice constraint? An experimental study with 120 Latin American Mayors. Journal of Public Administration Research and Theory, 23(3), pp. 631–661. doi:https://doi.org/10.1093/jopart/mus041.
- Baumgartner, F. R. and Jones, B. D., 2010, Agendas and Instability in American Politics (Chicago: University of Chicago Press).
- Beath, A., Christia, F., and Enikolopov, R., 2013, Empowering women through development aid: evidence from a field experiment in Afghanistan. The American Political Science Review, 107(3), pp. 540–557. doi:https://doi.org/10.1017/S0003055413000270.
- Bellé, N., 2013, Experimental evidence on the relationship between public service motivation and job performance. Public Administration Review, 73(1), pp. 143–153. doi:https://doi.org/10.1111/j.1540-6210.2012.02621.x.
- Bellé, N., 2015, Performance-related pay and the crowding out of motivation in the public sector: a randomized field experiment. Public Administration Review, 75(2), pp. 230–241. doi:https://doi.org/10.1111/puar.12313.
- Bergan, D. E., 2009, Does grassroots lobbying work? A field experiment measuring the effects of an e-Mail Lobbying Campaign on legislative behavior. American Politics Research, 37(2), pp. 327–352. doi:https://doi.org/10.1177/1532673X08326967.
- Berk, R. A., Smyth, G. K., and Sherman, L. W., 1988, When random assignment fails: some lessons from the Minneapolis spouse abuse experiment. Journal of Quantitative Criminology, 4(3), pp. 209–223. doi:https://doi.org/10.1007/BF01072450.
- Bhargava, S. and Manoli, D., 2015, Psychological frictions and the incomplete take-up of social benefits: evidence from an IRS field experiment. The American Economic Review, 105(11), pp. 3489–3529. doi:https://doi.org/10.1257/aer.20121493.
- Bloom, H. S., 1984, Estimating the effect of job-training programs, using longitudinal data: Ashenfelter’s findings reconsidered. The Journal of Human Resources, 19(4), pp. 544–556. doi:https://doi.org/10.2307/145947.
- Bloom, H. S., 1997, The benefits and costs of JTPA Title II-A programs: key findings from the national job training partnership act study. The Journal of Human Resources, 32(3), pp. 549–576. doi:https://doi.org/10.2307/146183.
- Boutron, I., John, P., and Torgerson, D. J., 2010, Reporting methodological items in randomized experiments in political science. Annals of the American Academy of Political and Social Science, 628, pp. 112–131. doi:https://doi.org/10.1177/0002716209351518.
- Bouwman, R. and Grimmelikhuijsen, S., 2016, Experimental public administration from 1992 to 2014: a systematic literature review and ways forward. International Journal of Public Sector Management, 29(2), pp. 110–131. doi:https://doi.org/10.1108/IJPSM-07-2015-0129.
- Bozeman, B. and Scott, P., 1992, Laboratory experiments in public policy and management. Journal of Public Administration Research and Theory, 2(3), pp. 293–313.
- Butler, D. M., 2010, Monitoring bureaucratic compliance: Using field experiments to improve governance, in: Public Sector Digest Winter, pp. 41–44.
- Butler, D. M., 2014, Representing the Advantaged: How Politicians Reinforce Inequality (Cambridge: Cambridge University Press).
- Butler, D. M., 2019, Facilitating field experiments at the subnational level. The Journal of Politics, 81(1), pp. 371–376. doi:https://doi.org/10.1086/700725.
- Butler, D. M. and Broockman, D. E., 2011, Do politicians racially discriminate against constituents? A field experiment on state legislators. American Journal of Political Science, 55(3), pp. 463–477. doi:https://doi.org/10.1111/j.1540-5907.2011.00515.x.
- Butler, D. M., Craig Volden, A., Dynes, M., and Shor, B., 2017, Ideology, learning, and policy diffusion: Experimental evidence. American Journal of Political Science, 61(1), pp. 37–49. doi:https://doi.org/10.1111/ajps.12213.
- Butler, D. M. and Nickerson, D. W., 2011, Can learning constituency opinion affect how legislators vote? Results from a field experiment. Quarterly Journal of Political Science, 6(1), pp. 55–83. doi:https://doi.org/10.1561/100.00011019.
- Campbell, D. T. 1957, Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54(4),297–312, doi:https://doi.org/10.1037/h0040950
- Campbell, D. T., 1969, Reforms as experiments. American Psychologist, 24(4), pp. 409–429. doi:https://doi.org/10.1037/h0027982.
- Campbell D. T. and Stanley J. C. 1963, Experimental and quasi-experimental designs for research. Chicago: Rand McNally & Company.
- Cartwright, N. and Hardie, J., 2012, Evidence-Based Policy: A Practical Guide to Doing It Better (Oxford: Oxford University Press).
- Chetty, R., Hendren, N., and Katz, L. F. 2015. The effects of exposure to better neighborhoods on children: New evidence from the moving to opportunity experiment. Working Paper. National Bureau of Economic Research. Available at http://www.nber.org/papers/w21156 (accessed December 29 2019).
- Chin, M. L., Bond, J. R., and Geva, N., 2000, A foot in the door: An experimental study of PAC and constituency effects on access. Journal of Politics, 62(2), pp. 534–549. doi:https://doi.org/10.1111/0022-3816.00024.
- Chong, A., De La, A. L., Dean Karlan, O., and Wantchekon, L., 2015, Does corruption information inspire the fight or quash the hope? A field experiment in mexico on voter turnout, choice, and party identification. The Journal of Politics, 77(1), pp. 55–71. doi:https://doi.org/10.1086/678766.
- Costa, M., 2017, How responsive are political elites? A meta-analysis of experiments on public officials. Journal of Experimental Political Science, 4(3), pp. 241–254. doi:https://doi.org/10.1017/XPS.2017.14.
- Deaton, A., 2010, Instruments, randomization, and learning about development. Journal of Economic Literature, 48(2), pp. 424–455. doi:https://doi.org/10.1257/jel.48.2.424.
- Deaton, A. and Cartwright, N., 2018, Understanding and misunderstanding randomized controlled trials. Social Science & Medicine, 210, pp. 2–21. doi:https://doi.org/10.1016/j.socscimed.2017.12.005.
- Desposato, S., ed, 2015, Ethics and Experiments. 1st ed. (New York, NY: Routledge).
- Druckman, J. N., Green, D. P., Kuklinski, J. H., and Lupia, A., 2006, The growth and development of experimental research in political science. American Political Science Review, 100(4), pp. 627–635. doi:https://doi.org/10.1017/S0003055406062514.
- Duflo, E., Glennerster, R., and Kremer, M., 2007, Using randomization in development economics research: a toolkit. Handbook of Development Economics, 4, pp. 3895–3962.
- Dunning, T., 2012, Natural Experiments in the Social Sciences: A Design-Based Approach (Cambridge: Cambridge University Press).
- Dunning, T., 2019, Voter information campaigns and political accountability: cumulative findings from a preregistered meta-analysis of coordinated trials. Science Advances, 5(7), pp. eaaw2612. doi:https://doi.org/10.1126/sciadv.aaw2612.
- Einstein, K. L. and Glick, D. M., 2017, Does race affect access to government services? An experiment exploring street-level bureaucrats and access to public housing. American Journal of Political Science, 61(1), pp. 100–116. doi:https://doi.org/10.1111/ajps.12252.
- Fearon, J. D., Humphreys, M., and Weinstein, J. M., 2009, Can development aid contribute to social cohesion after civil war? Evidence from a field experiment in post-conflict Liberia. American Economic Review, 99(2), pp. 287–291. doi:https://doi.org/10.1257/aer.99.2.287.
- Gallego, A. and Marx, P., 2017, Multi-dimensional preferences for labour market reforms: a conjoint experiment. Journal of European Public Policy, 24(7), pp. 1027–1047. doi:https://doi.org/10.1080/13501763.2016.1170191.
- Gerber, A. S. and Green, D. P., 2000, The effects of canvassing, telephone calls, and direct mail on voter turnout: a field experiment. American Political Science Review, 94, pp. 653. doi:https://doi.org/10.2307/2585837.
- Gerber, A. S. and Green, D. P., 2012, Field Experiments: Design, Analysis, and Interpretation (New York: WW Norton).
- Glennerster, R. and Takavarasha, K., 2013, Running Randomized Evaluations: A Practical Guide (Princeton: Princeton University Press).
- Green, D. P. and Gerber, A. S., 2019, Get Out the Vote. 4th ed. (Washington, D.C: Brookings Institution Press).
- Greenberg, D. H., Linksz, D., and Mandell, M., 2003, Social Experimentation and Public Policymaking (Washington, DC: The Urban Insitute).
- Greenberg, D. H. and Shroder, M., 2004, The Digest of Social Experiments (Washington, DC: The Urban Insitute).
- Grimmelikhuijsen, S., Herkes, F., et al., 2019, Can decision transparency increase citizen trust in regulatory agencies? Evidence from a representative survey experiment. Regulation & Governance. doi:https://doi.org/10.1111/rego.12278.
- Grimmelikhuijsen, S., John, P., Meijer, A., and Worthy, B., 2019, Do freedom of information laws increase transparency of government? A replication of a field experiment. Journal of Behavioral Public Administration, 2(1). Available at https://journal-bpa.org/index.php/jbpa/article/view/34 ((February 24 2019)).
- Grose, C. R., 2014, Field experimental work on political institutions. Annual Review of Political Science, 17, pp. 355–370. doi:https://doi.org/10.1146/annurev-polisci-072012-174350.
- Habel, P. and Birch, S., 2019, A field experiment on the effects of ethnicity and socioeconomic status on the quality of representation. Legislative Studies Quarterly, 44(3), pp. 389–420. doi:https://doi.org/10.1111/lsq.12230.
- Halpern, D., 2016, Inside the Nudge Unit: How Small Changes Can Make a Big Difference (New York: Random House).
- Hansen, J. A. and Tummers, L., 2020, A systematic review of field experiments in public administration. Public Administration Review. doi:https://doi.org/10.1111/puar.13181.
- Harrison, G. W., 2011, Randomisation and Its Discontents. Journal of African Economies, 20(4), pp. 626–652. doi:https://doi.org/10.1093/jae/ejr030.
- Harrison, G. W., 2013, Field experiments and methodological intolerance. Journal of Economic Methodology, 20(2), pp. 103–117. doi:https://doi.org/10.1080/1350178X.2013.804678.
- Haskins, R. and Margolis, G., 2014, Show Me the Evidence: Obama’s Fight for Rigor and Results in Social Policy (Washington DC: Brookings Institution Press).
- Haynes, L., Goldacre, B., and Torgerson, D., 2012, ‘Test, Learn, Adapt: Developing Public Policy with Randomised Controlled Trials| Cabinet Office’.
- Heller, S. B., et al., 2017, Thinking, fast and slow? Some field experiments to reduce crime and dropout in Chicago. The Quarterly Journal of Economics, 132(1), pp. 1–54. doi:https://doi.org/10.1093/qje/qjw033.
- Henderson, M., 2012, The Geek Manifesto: Why Science Matters (New York: Random House).
- Hess, D. R., Hanmer, M. J., and Nickerson, D. W., 2016, Encouraging local compliance with federal civil rights laws: field experiments with the national voter registration act. Public Administration Review, 76(1), pp. 165–174. doi:https://doi.org/10.1111/puar.12473.
- Humphreys, M. and Weinstein, J. M., 2009, Field experiments and the political economy of development. Annual Review of Political Science, 12, pp. 367–378. doi:https://doi.org/10.1146/annurev.polisci.12.060107.155922.
- James, O., Jilke, S., and Gregg, V. R., 2017, Experiments in Public Administration Research Challenges and Contributions (Cambridge: Cambridge University Press).
- James, O. and Moseley, A., 2014, Does performance information about public services affect citizens’ perceptions, satisfaction, and voice behaviour? Field experiments with absolute and relative performance information. Public Administration, 92(2), pp. 493–511. doi:https://doi.org/10.1111/padm.12066.
- John, P., 2017, Field Experiments in Political Science and Public Policy: Practical Lessons in Design and Delivery (New York: Taylor & Francis).
- John, P., 2018, How Far to Nudge?: Assessing Behavioural Public Policy. Cheltenham, UK; Northamption (MA: Edward Elgar Publishing Ltd).
- John, P., 2019, Nudge, Nudge, Think, Think: Experimenting with Ways to Change Citizen Behaviour. S.l. (Manchester, UK: Manchester University Press).
- Jones, B. D. and Baumgartner, F. R., 2005, The Politics of Attention: How Government Prioritizes Problems (Chicago: University of Chicago Press).
- Kaufmann, W. and Tummers, L., 2017, The negative effect of red tape on procedural satisfaction. Public Management Review, 19(9), pp. 1311–1327. doi:https://doi.org/10.1080/14719037.2016.1210907.
- Lijphart, A., 1971, Comparative Politics and the Comparative Method. The American Political Science Review, 65(3), pp. 682–693. doi:https://doi.org/10.2307/1955513.
- Lilienfeld, S. O., 2017, Psychology’s replication crisis and the grant culture: righting the ship. Perspectives on Psychological Science, 12(4), pp. 660–664. doi:https://doi.org/10.1177/1745691616687745.
- Lin, W. and Green, D. P., 2016, Standard operating procedures: a safety net for pre-analysis plans. PS: Political Science & Politics, 49(3), pp. 495–500.
- Linde, J. and Vis, B., 2017, Do politicians take risks like the rest of us? An experimental test of prospect theory under MPs. Political Psychology, 38(1), pp. 101–117. doi:https://doi.org/10.1111/pops.12335.
- Maxwell, S. E., Lau, M. Y., and Howard, G. S., 2015, Is psychology suffering from a replication crisis? What does “Failure to replicate” really Mean? American Psychologist, 70(6), pp. 487–498. doi:https://doi.org/10.1037/a0039400.
- McClendon, G. H., 2016, Race and responsiveness: an experiment with South African politicians. Journal of Experimental Political Science, 3(1), pp. 60–74. doi:https://doi.org/10.1017/XPS.2015.10.
- McCord, J., 1978, A thirty-year follow-up of treatment effects. American Psychologist, 33(3), pp. 284–289. doi:https://doi.org/10.1037/0003-066X.33.3.284.
- Miguel, E., et al., 2014, Promoting transparency in social science research. Science, 343(6166), pp. 30–31. doi:https://doi.org/10.1126/science.1245317.
- Nielsen, P. A. and Baekgaard, M., 2015, Performance information, blame avoidance, and politicians’ attitudes to spending and reform: evidence from an experiment. Journal of Public Administration Research and Theory, 25(2), pp. 545–569. doi:https://doi.org/10.1093/jopart/mut051.
- Nyhan, B. and Reifler, J., 2015, The effect of fact-checking on elites: a field experiment on US state legislators. American Journal of Political Science, 59(3), pp. 628–640. doi:https://doi.org/10.1111/ajps.12162.
- Olken, B. A., 2007, Monitoring corruption: evidence from a field experiment in Indonesia. Journal of Political Economy, 115(2), pp. 200–249. doi:https://doi.org/10.1086/517935.
- Pawson, R. and Tilley, N., 1997, Realistic Evaluation. 1st ed. (London; Thousand Oaks, CA: SAGE Publications Ltd).
- Pearl, J. and Mackenzie, D., 2018, The Book of Why: The New Science of Cause and Effect. 1st ed. (New York: Basic Books).
- Petrosino, A., Turpin-Petrosino, C., and Buehler, J., 2003, Scared straight and other Juvenile awareness programs for preventing juvenile delinquency: a systematic review of the randomized experimental evidence. The ANNALS of the American Academy of Political and Social Science, 589(1), pp. 41–62. doi:https://doi.org/10.1177/0002716203254693.
- Pollock, J., 2006, Two controlled trials of supplementary feeding of British School children in the 1920s. Royal Society of Medicine (Great Britain). Journal of the Royal Society of Medicine, 99(6), pp. 323.
- Porter, E. and Rogowski, J. C., 2018, Partisanship, bureaucratic responsiveness, and election administration: evidence from a field experiment. Journal of Public Administration Research and Theory, 28(4), pp. 602–617. doi:https://doi.org/10.1093/jopart/muy025.
- Przeworski, A. and Teune, H., 1966, Equivalence in cross-national research. Public Opinion Quarterly, 30(4), pp. 551–568. doi:https://doi.org/10.1086/267455.
- Putnam, R. D., Leonardi, R., and Nanetti, R. Y., 1994, Making Democracy Work: Civic Traditions in Modern Italy (Princeton: Princeton University Press).
- Riccio, J. A. and Bloom, H. S., 2002, Extending the reach of randomized social experiments: new directions in evaluations of American welfare-to-work and employment initiatives. Journal of the Royal Statistical Society: Series A (Statistics in Society), 165(1), pp. 13–30. doi:https://doi.org/10.1111/1467-985X.0asp4.
- Richardson, L. and John, P., 2012, Who listens to the grass roots? A field experiment on informational lobbying in the UK. The British Journal of Politics and International Relations, 14(4), pp. 595–612. doi:https://doi.org/10.1111/j.1467-856X.2011.00481.x.
- Robins, P. K. and Spiegelman, R. G., 2001, Reemployment Bonuses in the Unemployment Insurance System: Evidence from Three Field Experiments (Kalamazoo, Michigan: W.E. Upjohn Institute).
- Ryan, M., et al., 2018, How best to open up local democracy? A randomised experiment to encourage contested elections and greater representativeness in English Parish Councils. Local Government Studies, 44:6, 766-787, https://doi.org/10.1080/03003930.2018.1473769
- Shadish, W. R., Cook, T. D., and Campbell, D. T., 2002, Experimental and Quasi-Experimental Designs for Generalized Causal Inference (Boston, MA: Houghton Mifflin).
- Shadish, W. R., Cook, T. D., and Leviton, L. C., 1991, Foundations of Program Evaluation: Theories of Practice (Newbury Park: SAGE).
- Sheffer, L., et al., 2018, Nonrepresentative representatives: an experimental study of the decision making of elected politicians. American Political Science Review, 112(2), pp. 302–321. doi:https://doi.org/10.1017/S0003055417000569.
- Sherman, L. W. and Weisburd, D., 1995, General deterrent effects of police patrol in crime “Hot spots”: a randomized, controlled trial. Justice Quarterly, 12(4), pp. 625–648. doi:https://doi.org/10.1080/07418829500096221.
- Simon, H. A., 1955, A behavioral model of rational choice. The Quarterly Journal of Economics, 69(1), pp. 99–118. doi:https://doi.org/10.2307/1884852.
- Student, 1931, The Lanarkshire milk experiment. Biometrika, 23(3/4), pp. 398–406. doi:https://doi.org/10.2307/2332424.
- Teune, H. and Przeworski, A., 1970, The Logic of Comparative Social Inquiry (New York: Wiley-Interscience).
- Torgerson, D. and Torgerson, C., 2008, Designing Randomised Trials in Health, Education and the Social Sciences: An Introduction (New York: Springer).
- Treasury, H. M., 2011, The Magenta Book: Guidance for Evaluation HM Treasury (London: HM Treasury)).
- Tummers, L., Weske, U., Bouwman, R., and Grimmelikhuijsen, S., 2016, The impact of red tape on citizen satisfaction: an experimental study. International Public Management Journal, 19(3), pp. 320–341. doi:https://doi.org/10.1080/10967494.2015.1027800.
- van der Heijden, J., Kuhlmann, J., Lindquist, E., and Wellstead, A., 2019, Have policy process scholars embraced causal mechanisms? A review of five popular frameworks. Public Policy and Administration. Early view. doi:https://doi.org/10.1177/0952076718814894.
- White, A. R., Nathan, N. L., and Faller, J. K., 2015, What do I need to vote? Bureaucratic discretion and discrimination by local election officials. American Political Science Review, 109(1), pp. 129–142. doi:https://doi.org/10.1017/S0003055414000562.
- White, M. and Lakey, J., 1992, Restart Effect (London: PSI).
- Wittels, A. 2020. In and out Bu ̈rger: A field experiment testing behavioural interventions to increase engagement of bureaucrats with information from and about citizens. Available at https://osf.io/preprints/socarxiv/qvfd6/ (March 20 2020).
- Worthy, B., John, P., and Vannoni, M., 2017, Transparency at the Parish pump: a field experiment to measure the effectiveness of freedom of information requests in England. Journal of Public Administration Research and Theory, 27(3), pp. 485–500.