Generalizing the Results from Social Experiments: Theory and Evidence from India

References

• Allcott, H. (2015), “Site Selection Bias in Program Evaluation,” Quarterly Journal of Economics, 130, 1117–1165. DOI: 10.1093/qje/qjv015.
   Web of Science ®Google Scholar
• Altonji, J., Elder, T., and Taber, C. (2005), “Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools,” Journal of Political Economy, 113, 151–184. DOI: 10.1086/426036.
   Web of Science ®Google Scholar
• Andor, M., Peters, J., Gerster, A., and Schmidt, C. M. (2020), “Social Norms and Energy Conservation Beyond the US,” Journal of Environmental Economics and Management, 103, 102351. DOI: 10.1016/j.jeem.2020.102351.
   Web of Science ®Google Scholar
• Andrews, D., and Soares, G. (2010), “Inference for Parameters Defined by Moment Inequalities Using Generalized Moment Selection,” Econometrica, 78, 119–157.
   Web of Science ®Google Scholar
• Andrews, I., and Oster, E. (2019), “A Simple Approximation for Evaluating External Validity Bias,” Economics Letters, 178, 58–62. DOI: 10.1016/j.econlet.2019.02.020.
   Web of Science ®Google Scholar
• Angrist, J., and Fernández-Val, I. (2013), “ExtrapoLATE-ing: External Validity and Overidentification in the LATE Framework,” in Advances in Economics and Econometrics: Theory and Applications, Tenth World Congress, Volume III: Econometrics. Econometric Society Monographs.
   Google Scholar
• Angrist, J., and Rokkanen, M. (2015), “Wanna Get Away? Regression Discontinuity Estimation of Exam School Effects Away from the Cutoff,” Journal of the American Statistical Association, 110, 1331–1344. DOI: 10.1080/01621459.2015.1012259.
   Web of Science ®Google Scholar
• Athey, S., and Imbens, G. (2006), “Identification and Inference in Nonlinear Difference-in-Differences Models,” Econometrica, 74, 431–497. DOI: 10.1111/j.1468-0262.2006.00668.x.
   Web of Science ®Google Scholar
• Attanasio, O., Meghir, C., and Szekely, M. (2003), “Using Randomised Experiments and Structural Models for ‘Scaling Up’: Evidence from the PROGRESA Evaluation,” Mimeo.
   Google Scholar
• Bai, Y., Santos, A., and Shaikh, A. (2022), “On Testing Systems of Linear Inequalities with Known Coefficients,” working paper.
   Google Scholar
• Banerjee, A., Cole, S., Duflo, E., and Linden, L. (2007), “Remedying Education: Evidence from Two Randomized Experiments in India,” Quarterly Journal of Economics, 122, 1235–1264. DOI: 10.1162/qjec.122.3.1235.
   Web of Science ®Google Scholar
• Bitler, M., Gelbach, J., and Hoynes, H. (2006), “What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments,” American Economic Review, 96, 988–1012. DOI: 10.1257/aer.96.4.988.
   Web of Science ®Google Scholar
• Bold, T., Kimenyi, M., Mwabu, G., Ng, A., and Sandefur, J. (2018), “Experimental Evidence on Scaling Up Education Reforms in Kenya,” Journal of Public Economics, 168, 1–20. DOI: 10.1016/j.jpubeco.2018.08.007.
   Web of Science ®Google Scholar
• Boyd, S., and Vandenberghe, L. (2004), Convex Optimization, Cambridge: Cambridge University Press.
   Google Scholar
• Bugni, F. A., Canay, I. A., and Shi, X. (2017), “Inference for Subvectors and Other Functions of Partially Identified Parameters in Moment Inequality Models,” Quantitative Economics, 8, 1–38. DOI: 10.3982/QE490.
   Web of Science ®Google Scholar
• Cambanis, S., Simons, G., and Stout, W. (1976), “Inequalities for E(k(X, Y)) When the Marginals Are Fixed,” Zeitschrift Für Wahrscheinlichskeitstheorie, 36, 285–294. DOI: 10.1007/BF00532695.
   Web of Science ®Google Scholar
• Cole, S., and Stuart, E. (2010), “Generalizing Evidence from Randomized Clinical Trials to Target Populations: The ACTG 320 Trial,” American Journal of Epidemiology, 172, 107–115. DOI: 10.1093/aje/kwq084.
   PubMed Web of Science ®Google Scholar
• Deaton, A. (2010), “Instruments, Randomization, and Learning about Development,” Journal of Economic Literature, 48, 424–455. DOI: 10.1257/jel.48.2.424.
   Web of Science ®Google Scholar
• Deaton, A., and Cartwright, N. (2016), “Understanding and Misunderstanding Randomized Controlled Trials,” National Bureau of Economic Research working paper series, No. 22595.
   Google Scholar
• Dehejia, R., Pop-Eleches, C., and Samii, C. (2019), “From Local to Global: External Validity in a Fertility Natural Experiment,” Journal of Business and Economic Statistics, 39, 217–243. DOI: 10.1080/07350015.2019.1639407.
   Web of Science ®Google Scholar
• Dehejia, R. H. (2003), “Was There a Riverside Miracle? A Hierarchical Framework for Evaluating Programs With Grouped Data,” Journal of Business and Economic Statistics, 21, 1–11. DOI: 10.1198/073500102288618702.
   Web of Science ®Google Scholar
• Djebbari, H., and Smith, J. (2008), “Heterogeneous Impacts in PROGRESA,” Journal of Econometrics, 145, 64–80. DOI: 10.1016/j.jeconom.2008.05.012.
   Web of Science ®Google Scholar
• Fan, Y., and Park, S. (2010), “Sharp Bounds on the Distribution of Treatment Effects and Their Statistical Inference,” Econometric Theory, 26, 931–951. DOI: 10.1017/S0266466609990168.
   Web of Science ®Google Scholar
• Fang, Z., Santos, A., Shaikh, A., and Torgovitsky, A. (2022), “Inference for Large-Scale Linear Systems with Known Coefficients,” Econometrica, Forthcoming. DOI: 10.3982/ECTA18979.
   Google Scholar
• Flores, C., and Mitnik, O. (2013), “Comparing Treatments across Labor Markets: An Assessment of Nonexperimental Multiple-Treatment Strategies,” Review of Economics and Statistics, 95, 1691–1707. DOI: 10.1162/REST_a_00373.
   Web of Science ®Google Scholar
• Galichon, A. (2016), Optimal Transport Methods in Economics, Princeton: Princeton University Press.
   Google Scholar
• Gechter, M. (2022), “Generalizing the Results from Social Experiments: Theory and Evidence from Mexico and India,” The Pennsylvania State University Department of Economics working paper.
   Google Scholar
• Genest, C., and Nešlehová, J. (2007), “A Primer on Copulas for Count Data,” ASTIN Bulletin, 37, 475–515. DOI: 10.2143/AST.37.2.2024077.
   Web of Science ®Google Scholar
• Gerard, F., Rokkanen, M., and Rothe, C. (2020), “Bounds on Treatment Effects in Regression Discontinuity Designs with Amanipulated Running Variable,” Quantitative Economics, 11, 839–870. DOI: 10.3982/QE1079.
   Web of Science ®Google Scholar
• Grant, M., and Boyd, S. (2020), “CVX: Matlab Software for Disciplined Convex Programming, version 2.2.”
   Google Scholar
• Grant, M., Boyd, S., and Ye, Y. (2006), “Disciplined Convex Programming,” in Global Optimization: From Theory to Implementation, eds. L. Liberti and N. Maculan, pp. 155–210, Boston: Springer. DOI: 10.1007/0-387-30528-9_7.
   Google Scholar
• Heckman, J. J., Smith, J., and Clements, N. (1997), “Making the Most Out of Programme Evaluations and Social Experiments: Accounting for Heterogeneity in Programme Impacts,” The Review of Economic Studies, 64, 487–535. DOI: 10.2307/2971729.
   Web of Science ®Google Scholar
• Hoderlein, S., and Stoye, J. (2014), “Revealed Preferences in a Heterogeneous Population,” Review of Economics and Statistics, 96, 197–213. DOI: 10.1162/REST_a_00397.
   Web of Science ®Google Scholar
• Hotz, V. J., Imbens, G., and Mortimer, J. (2005), “Predicting the Efficacy of Future Training Programs Using Past Experiences at Other Locations,” Journal of Econometrics, 125, 241–270. DOI: 10.1016/j.jeconom.2004.04.009.
   Web of Science ®Google Scholar
• Imbens, G. W. (2003), “Sensitivity to Exogeneity Assumptions in Program Evaluation,” American Economic Review, Papers and Proceedings, 93, 126–132. DOI: 10.1257/000282803321946921.
   Web of Science ®Google Scholar
• Kaido, H., Molinari, F., Stoye, J., and Thirkettle, M. (2017), “Calibrated Projection in MATLAB : Users’ Manual.”
   Google Scholar
• Kaido, H., Molinari, F., and Stoye, J. (2019), “Confidence Intervals for Projections of Partially Identified Parameters,” Econometrica, 87, 1397–1432. DOI: 10.3982/ECTA14075.
   Web of Science ®Google Scholar
• Manski, C. F. (1990), “Nonparametric Bounds on Treatment Effects,” American Economic Review, Papers and Proceedings, 80, 829–823.
   Web of Science ®Google Scholar
• Meager, R. (2019), “Understanding the Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of 7 Randomised Experiments,” American Economic Journal: Applied Economics, 11, 57–91. DOI: 10.1257/app.20170299.
   Web of Science ®Google Scholar
• Muller, S. (2014), “Randomized Trials for Policy: A Review of the External Validity of Treatment Effects,” Mimeo.
   Google Scholar
• Nelsen, R. (2006), An Introduction to Copulas (2nd ed.), New York: Springer.
   Google Scholar
• Nešlehová, J. (2007), “On Rank Correlation Measures for Non-Continuous Random Variables,” Journal of Multivariate Analysis, 98, 544–567. DOI: 10.1016/j.jmva.2005.11.007.
   Web of Science ®Google Scholar
• Nguyen, T. Q., Ebnesajjad, C., Cole, S. R., and Stuart, E. A. (2017), “Sensitivity Analysis for an Unobserved Moderator in RCT-to-Target-Population Generalization of Treatment Effects,” Annals of Applied Statistics, 11, 225–247.
   Web of Science ®Google Scholar
• Nie, X., Imbens, G., and Wager, S. (2021), “Covariate Balancing Sensitivity Analysis for Extrapolating Randomized Trials across Locations,” working paper.
   Google Scholar
• Oster, E. (2019), “Unobservable Selection and Coefficient Stability: Theory and Validation,” Journal of Business and Economic Statistics, 37, 187–204. DOI: 10.1080/07350015.2016.1227711.
   Web of Science ®Google Scholar
• Pearl, J., and Bareinboim, E. (2014), “External Validity: From do-calculus to Transportability across Populations,” Statistical Science, 29, 579–595. DOI: 10.1214/14-STS486.
   Web of Science ®Google Scholar
• Pritchett, L., and Sandefur, J. (2013), “Context Matters for Size: Why External Validity Claims and Development Practice Don’t Mix,” Journal of Globalization and Development, 4, 161–197.
   Google Scholar
• Rambachan, A., and Roth, J. (2021), “An Honest Approach to Parallel Trends,” Working Paper.
   Google Scholar
• Rosenbaum, P. (2002), Observational Studies, New York: Springer.
   Google Scholar
• Stuart, E., Cole, S., Bradshaw, C., and Leaf, P. (2011), “The Use of Propensity Scores to Assess the Generalizability of Results from Randomized Trials,” Journal of the Royal Statistical Society, Series A, 174, 369–386. DOI: 10.1111/j.1467-985X.2010.00673.x.
   Web of Science ®Google Scholar
• Villani, C. (2009), Optimal Transport: Old and New, Berlin: Springer.
   Google Scholar
• Vivalt, E. (2020), “How Much Can We Generalize From Impact Evaluations?,” Journal of the European Economic Association, 18, 3045–3089. DOI: 10.1093/jeea/jvaa019.
   Web of Science ®Google Scholar