Multiple Testing and the Distributional Effects of Accountability Incentives in Education

References

• Abadie, A., and Cattaneo, M. D. (2018), “Econometric Methods for Program Evaluation,” Annual Review of Economics, 10, 465–503. DOI: 10.1146/annurev-economics-080217-053402.
   Web of Science ®Google Scholar
• Andrabi, T., Das, J., and Khwaja, A. I. (2017), “Report Cards: The Impact of Providing School and Child Test Scores on Educational Markets,” American Economic Review, 107, 1535–63. DOI: 10.1257/aer.20140774.
   Web of Science ®Google Scholar
• Athey, S., and Imbens, G. W. (2017), “The Econometrics of Randomized Experiments.” in Handbook of Economic Field Experiments, Vol. 1, eds. A. Banerjee and E. Duflo, Chap. 3. Amsterdam: Elsevier, 73–140.
   Google Scholar
• Becker, G. S. (1995), “Human Capital and Poverty Alleviation,” Human Resources Development and Operations Policy Working Paper 52.
   Google Scholar
• Bitler, M. P., Gelbach, J. B., and Hoynes, H. W. (2006), “What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments,” American Economic Review, 96, 988–1012. DOI: 10.1257/aer.96.4.988.
   Web of Science ®Google Scholar
• Bitler, M. P., Gelbach, J. B., and Hoynes, H. W. (2008), “Distributional Impacts of the Self-Sufficiency Project,” Journal of Public Economics, 92, 748–765.
   Web of Science ®Google Scholar
• Bitler, M. P., Gelbach, J. B., and Hoynes, H. W. (2017), “Can Variation in Subgroups’ Average Treatment Effects Explain Treatment Effect Heterogeneity? Evidence From a Social Experiment,” Review of Economics and Statistics, 99, 683–697.
   Web of Science ®Google Scholar
• Bitler, M. P., Hoynes, H. W., and Domina, T. (2014), “Experimental Evidence on Distributional Effects of Head Start,” NBER Working Paper 20434.
   Google Scholar
• Brinch, C. N., Mogstad, M., and Wiswall, M. (2017), “Beyond LATE With a Discrete Instrument,” Journal of Political Economy, 125, 985–1039. DOI: 10.1086/692712.
   Web of Science ®Google Scholar
• Bugni, F., Canay, I. A., and Shaikh, A. M. (2018), “Inference Under Covariance-Adaptive Randomization,” Journal of the American Statistical Association, 113, 1741–1768. DOI: 10.1080/01621459.2017.1375934.
   Web of Science ®Google Scholar
• Camargo, B., Camelo, R., Firpo, S., and Ponczek, V. (2014), “Information, Market Incentives, and Student Performance,” IZA Discussion Paper 7941.
   Google Scholar
• Camargo, B., Camelo, R., Firpo, S., and Ponczek, V. (2018), “Information, Market Incentives, and Student Performance: Evidence from a Regression Discontinuity Design in Brazil,” Journal of Human Resources, 53, 414–444.
   Web of Science ®Google Scholar
• Carneiro, P., Das, J., and Reis, H. (2013), “Parental Valuation of School Attributes in Developing Countries: Evidence from Pakistan,” Unpublished manuscript.
   Google Scholar
• Cattaneo, M. D. (2010), “Efficient Semiparametric Estimation of Multi-Valued Treatment Effects Under Ignorability,” Journal of Econometrics, 155, 138–154.
   Web of Science ®Google Scholar
• Chernozhukov, V., and Fernandéz-Val, I. (2005), “Subsampling Inference on Quantile Regression Processes,” Sankhya, 67, 253–276.
   Google Scholar
• Chernozhukov, V., Fernandez-Val, I., and Melly, B. (2013), “Inference on Counterfactual Distributions,” Econometrica, 81, 2205–2268.
   Web of Science ®Google Scholar
• Chung, E. Y., and Olivares, M. (2020), “Permutation Test for Heterogeneous Treatment Effects With a Nuisance Parameter,” unpublished manuscript.
   Google Scholar
• Crump, Richard K., Joseph Hotz, V., Imbens, G. W., and Mitnik, O. A. (2008), “Nonparametric Tests for Treatment Effect Heterogeneity,” Review of Economics and Statistics, 90, 389–405. DOI: 10.1162/rest.90.3.389.
   Web of Science ®Google Scholar
• Ding, P., Feller, A., and Miratrix, L. (2016), “Randomization Inference for Treatment Effect Variation,” Journal of the Royal Statistical Society, Series B, 78, 655–671.
   Google Scholar
• Ding, W., and Lehrer, S. F. (2007), “Do Peers Affect Student Achievement in China’s Secondary Schools?” The Review of Economics and Statistics 89, 300–312. DOI: 10.1162/rest.89.2.300.
   Google Scholar
• Djebbari, H., and Smith, J. (2008), “Heterogeneous Impacts in PROGRESA,” Journal of Econometrics, 145, 64–80.
   Web of Science ®Google Scholar
• Donald, S. G., and Hsu, Y.-C. (2014), “Estimation and Inference for Distribution Functions and Quantile Functions in Treatment Effect Models,” Journal of Applied Econometrics, 178, 383–397.
   Google Scholar
• Fan, Y., and Wu, J. (2010), “Partial Identification of the Distribution of Treatment Effects in Switching Regime Models and Its Confidence Sets,” Review of Economic Studies, 77, 1002–1041.
   Web of Science ®Google Scholar
• Figlio, D., and Loeb, S. (2011), “School Accountability,” in Handbook of the Economics of Education (Chapter 8, Vol. 3), eds. E. A. Hanushek, S. Machin, and L. Woessman, Amsterdam: Elsevier, pp. 383–421.
   Google Scholar
• Firpo, S. (2007), “Efficient Semiparametric Estimation of Quantile Treatment Effects,” Econometrica, 75, 259–276.
   Web of Science ®Google Scholar
• Firpo, S., and Pinto, C. (2016), “Identification and Estimation of Distributional Impacts of Interventions Using Changes in Inequality Measures,” Journal of Applied Econometrics, 31, 457–486.
   Web of Science ®Google Scholar
• Friedlander, D., and Robins, P. K. (1997), “The Distributional Impacts of Social Programs,” Evaluation Review, 21, 531–553.
   Web of Science ®Google Scholar
• Friedman, M. (1955), The Role of Government in Education, New Brunswick, NJ: Rutgers University Press.
   Google Scholar
• Friesen, J., Javdani, M., Smith, J., and Woodcock, S. (2012), “How Do School Report Cards Affect School Choice Decisions?” Canadian Journal of Economics/Revue Canadienne d’économique 45, 784–807.
   Web of Science ®Google Scholar
• Galvao, A., and Liang (2015), “Uniformly Semiparametric Efficient Estimation of Treatment Effects With a Continuous Treatment,” Journal of the American Statistical Association, 110, 1528–1542.
   Web of Science ®Google Scholar
• Gibbons, S., and Machin, S. (2006), “Paying for Primary Schools: Admission Constraints, School Popularity or Congestion?” The Economic Journal 116, C77–C92.
   Web of Science ®Google Scholar
• Goldman, M., and Kaplan, D. M. (2018), “Comparing Distributions by Multiple Testing Across Quantiles or CDF Values,” Journal of Econometrics, 206, 143–166.
   Web of Science ®Google Scholar
• Guerre, E., and Sabbah, C. (2012), “Uniform Bias Study and Bahadur Representation for Local Polynomial Estimators of the Conditional Quantile Function,” Econometric Theory, 28, 87–129. DOI: 10.1017/S0266466611000132.
   Web of Science ®Google Scholar
• Hahn, J. (1995), “Bootstrapping Quantile Regression Estimators,” Econometric Theory, 11, 105–121. DOI: 10.1017/S0266466600009051.
   Web of Science ®Google Scholar
• Hastings, J., Kane, T. J., and Staiger, D. O. (2009), “Heterogeneous Preferences and the Efficacy of Public School Choice,” NBER Working Paper 12145.
   Google Scholar
• Hastings, J. S., and Weinstein, J. M. (2008), “Information, School Choice, and Academic Achievement: Evidence From Two Experiments,” The Quarterly Journal of Economics, 123, 1373–1414. DOI: 10.1162/qjec.2008.123.4.1373.
   Web of Science ®Google Scholar
• Heckman, J. J., Smith, J., and Clements, N. (1997), “Making The Most Out of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts,” Review of Economic Studies, 64, 487–535. DOI: 10.2307/2971729.
   Web of Science ®Google Scholar
• Heckman, J. J., and Vytlacil, E. (2005), “Structural Equations, Treatment Effects, and Econometric Policy Evaluation”, Econometrica, 73, 669–738.
   Web of Science ®Google Scholar
• Holmström, B. (1999), “Managerial Incentive Problems: A Dynamic Perspective,” The Review of Economic Studies 66, 169–182.
   Web of Science ®Google Scholar
• Hoxby, C. M. (2003), “School Choice and School Productivity. Could School Choice be a Tide That Lifts All Boats?” in The Economics of School Choice, ed. C. M. Hoxby, Chap. 8. Chicago, IL: University of Chicago Press, pp. 287–342.
   Google Scholar
• Jiang, L., Liu, X., Phillips, P. C. B., and Zhang, Y. (2020), “Bootstrap Inference for Quantile Treatment Effects in Randomized Experiments with Matched Pairs,” unpublished manuscript.
   Google Scholar
• Kato, K. (2009), “Asymptotics for Argmin Processes: Convexity Arguments,” Journal of Multivariate Analysis, 100, 1816–1829.
   Web of Science ®Google Scholar
• Khan, S., and Tamer, E. (2010), “Irregular Identification, Support Conditions, and Inverse Weight Estimation,” Econometrica, 78, 2021–2042.
   Web of Science ®Google Scholar
• Koenker, R., and Xiao, Z. (2002). “Inference on the Quantile Regression Process,” Econometrica, 70, 1583–1612.
   Web of Science ®Google Scholar
• Koning, P., and Van der Wiel, K. (2012), “School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands,” De Economist, 160, 339–355.
   Web of Science ®Google Scholar
• Kottelenberg, M. J., and Lehrer, S. F. (2017), “Targeted or Universal Coverage? Assessing Heterogeneity in the Effects of Universal Child Care,” Journal of Labor Economics, 35, 609–653. DOI: 10.1086/690652.
   Web of Science ®Google Scholar
• Lee, Soohyung and Shaikh, A. M. (2014), “Multiple Testing and Heterogeneous Treatment Effects: Re-Evaluating the Effect of PROGRESA on School Enrollment,” Journal of Applied Econometrics, 29, 612–626.
   Web of Science ®Google Scholar
• Lehmann, E. L., and Romano, J. P. (2005), Testing Statistical Hypotheses, New York: Springer.
   Google Scholar
• List, John A., Shaikh, A. M., and Xu, Y. (2019), “Multiple Hypothesis Testing in Experimental Economics,” Experimental Economics, 22, 773–793.
   Web of Science ®Google Scholar
• Ma, X., and Wang, J. (2020), “Robust Inference Using Inverse Probability Weighting,” Journal of the American Statistical Association, 115, 1851–1860.
   Web of Science ®Google Scholar
• Maier, M. (2011), “Tests For Distributional Treatment Effects Under Unconfoundedness,” Economics Letters, 110, 49–51.
   Web of Science ®Google Scholar
• Massart, P. (2007), Concentration Inequalities and Model Selection, Berlin: Springer.
   Google Scholar
• Milgrom, P., and Roberts, J. (1986), “Price and Advertising Signals of Product Quality,” Journal of Political Economy, 94, 796–821.
   Web of Science ®Google Scholar
• Romano, J. P., and Shaikh, A. M. (2010), “Inference for the Identified Set in Partially Identified Econometric Models,” Econometrica, 78, 169–211.
   Web of Science ®Google Scholar
• Romano, J. P., and Wolf, M. (2005), “Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing,” Journal of the American Statistical Association, 100, 94–108. DOI: 10.1198/016214504000000539.
   Web of Science ®Google Scholar
• Schneider, M., Elacqua, G., and Buckley, J. (2006), “School Choice in Chile: Is It Class or the Classroom?” Journal of Policy Analysis and Management 25, 577–601.
   Web of Science ®Google Scholar
• Shapiro, C. (1983), “Premiums for High Quality Products as Returns to Reputations,” The Quarterly Journal of Economics, 98, 659–679. DOI: 10.2307/1881782.
   Web of Science ®Google Scholar
• Smith, J. A., and Todd, P. E. (2005), “Does Matching Overcome LaLonde’s Critique of Nonexperimental Estimators?” Journal of Econometrics 125, 305–353.
   Web of Science ®Google Scholar
• Wolinsky, A. (1983), “Prices as Signals of Product Quality,” The Review of Economic Studies, 50, 647–658. DOI: 10.2307/2297767.
   Web of Science ®Google Scholar
• Zhang, Y., and Zheng, X. (2020), “Quantile Treatment Effects and Bootstrap Inference Under Covariate-Adaptive Randomization,” Quantitative Economics, 11, 957–982.
   Web of Science ®Google Scholar