A Causal Framework for Observational Studies of Discrimination

References

• Ayres, I. (2002), “Outcome Tests of Racial Disparities in Police Practices,” Justice Research and Policy, 4, 131–142. DOI: 10.3818/JRP.4.1.2002.131.
   Google Scholar
• Balsa, A. I., McGuire, T. G., and Meredith, L. S. (2005), “Testing for Statistical Discrimination in Health Care,” Health Services Research, 40, 227–252. DOI: 10.1111/j.1475-6773.2005.00351.x.
   PubMed Web of Science ®Google Scholar
• Baum, S., and Goodstein, E. (2005), “Gender Imbalance in College Applications: Does it Lead to a Preference for Men in the Admissions Process?” Economics of Education Review, 24, 665–675.
   Web of Science ®Google Scholar
• Berg, N., and Lien, D. (2002), “Measuring the Effect of Sexual Orientation on Income: Evidence of Discrimination?” Contemporary Economic Policy, 20, 394–414.
   Web of Science ®Google Scholar
• Bertrand, M., and Mullainathan, S. (2004), “Are Emily and Greg More Employable than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination,” American Economic Review, 94, 991–1013.
   Web of Science ®Google Scholar
• Billingsley, P. (2008), Probability and Measure, New Delhi: Wiley.
   Google Scholar
• Carnegie, N. B., Harada, M., and Hill, J. L. (2016), “Assessing Sensitivity to Unmeasured Confounding Using a Simulated Potential Confounder,” Journal of Research on Educational Effectiveness, 9, 395–420.
   Web of Science ®Google Scholar
• Chohlas-Wood, A., Nudell, J., Yao, K., Lin, Z., Nyarko, J., and Goel, S. (2021), “Blind Justice: Algorithmically Masking Race in Charging Decisions,” in Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society, pp. 35–45.
   Google Scholar
• Cinelli, C., and Hazlett, C. (2020), “Making Sense of Sensitivity: Extending Omitted Variable Bias,” Journal of the Royal Statistical Society, Series B, 82, 39–67.
   Google Scholar
• Cornfield, J., Haenszel, W., Hammond, E. C., Lilienfeld, A. M., Shimkin, M. B., and Wynder, E. L. (1959), “Smoking and Lung Cancer: Recent Evidence and a Discussion of Some Questions,” Journal of the National Cancer Institute, 22, 173–203.
   PubMed Web of Science ®Google Scholar
• Dorie, V., Harada, M., Carnegie, N. B., and Hill, J. (2016), “A Flexible, Interpretable Framework for Assessing Sensitivity to Unmeasured Confounding,” Statistics in Medicine, 35, 3453–3470.
   PubMed Web of Science ®Google Scholar
• Edelman, B. G., and Luca, M. (2014), “Digital Discrimination: The Case of airbnb.com,” Harvard Business School NOM Unit Working Paper, 14–054.
   Google Scholar
• Franks, A., D’Amour, A., and Feller, A. (2019), “Flexible Sensitivity Analysis for Observational Studies Without Observable Implications,” Journal of the American Statistical Association, 115, 1730–1746.
   Web of Science ®Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2001), The Elements of Statistical Learning. Springer Series in Statistics, New York: Springer.
   Google Scholar
• Fryer Jr, R. G. (2019), “An Empirical Analysis of Racial Differences in Police use of Force,” Journal of Political Economy, 127, 1210–1261.
   Web of Science ®Google Scholar
• Gelman, A., Fagan, J., and Kiss, A. (2007), “An Analysis of the New York City Police Department’s “Stop-and-Frisk” Policy in the Context of Claims of Racial Bias,” Journal of the American Statistical Association, 102, 813–823.
   Web of Science ®Google Scholar
• Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., and Rubin, D. B. (2013), Bayesian Data Analysis, Boca Raton, FL: CRC Press.
   Google Scholar
• Goel, S., Perelman, M., Shroff, R., and Sklansky, D. A. (2017), “Combatting Police Discrimination in the Age of Big Data,” New Criminal Law Review: An International and Interdisciplinary Journal, 20, 181–232.
   Web of Science ®Google Scholar
• Goldin, C., and Rouse, C. (2000), “Orchestrating Impartiality: The Impact of “Blind” Auditions on Female Musicians,” American Economic Review, 90, 715–741.
   Web of Science ®Google Scholar
• Greenberg, D., Gershenson, C., and Desmond, M. (2016), “Discrimination in Evictions: Empirical Evidence and Legal Challenges,” Harvard Civil Rights-Civil Liberties Law Review, 51, 115–158.
   Web of Science ®Google Scholar
• Greiner, D. J., and Rubin, D. B. (2011), “Causal Effects of Perceived Immutable Characteristics,” Review of Economics and Statistics, 93, 775–785.
   Web of Science ®Google Scholar
• Grogger, J., and Ridgeway, G. (2006), “Testing for Racial Profiling in Traffic Stops from Behind a Veil of Darkness,” Journal of the American Statistical Association, 101, 878–887.
   Web of Science ®Google Scholar
• Heckman, J. J. (1979), “Sample Selection Bias as a Specification Error,” Econometrica: Journal of the Econometric Society, 47, 153–161.
   Web of Science ®Google Scholar
• Heckman, J. J., and Durlauf, S. N. (2020), Comment on “An Empirical Analysis of Racial Differences in Police use of Force” by Roland G. Fryer Jr., Journal of Political Economy.
   PubMed Web of Science ®Google Scholar
• Hill, J. L. (2011), “Bayesian Nonparametric Modeling for Causal Inference,” Journal of Computational and Graphical Statistics, 20, 217–240.
   Web of Science ®Google Scholar
• Holland, P. W. (1986), “Statistics and Causal Inference,” Journal of the American Statistical Association, 81, 945–960.
   Web of Science ®Google Scholar
• Imai, K., Keele, L., and Tingley, D. (2010a), “A General Approach to Causal Mediation Analysis,” Psychological Methods, 15, 309–334.
   PubMed Web of Science ®Google Scholar
• Imai, K., Keele, L., and Yamamoto, T. (2010b), “Identification, Inference and Sensitivity Analysis for Causal Mediation Effects,” Statistical Science, 25, 51–71.
   Web of Science ®Google Scholar
• Imbens, G. W. (2003), “Sensitivity to Exogeneity Assumptions in Program Evaluation,” The American Economic Review, 93, 126–132.
   Web of Science ®Google Scholar
• Imbens, G. W., and Rubin, D. B. (2015), Causal Inference in Statistics, Social, and Biomedical Sciences, New York: Cambridge University Press.
   Google Scholar
• Jung, J., Corbett-Davies, S., Shroff, R., and Goel, S. (2018), “Omitted and Included Variable Bias in Tests for Disparate Impact,” arXiv preprint arXiv:1809.05651.
   Google Scholar
• Jung, J., Shroff, R., Feller, A., and Goel, S. (2020), “Bayesian Sensitivity Analysis for Offline Policy Evaluation,” in Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, pp. 64–70.
   Google Scholar
• Knox, D., Lowe, W., and Mummolo, J. (2020), “Administrative Records Mask Racially Biased Policing,” American Political Science Review, 114, 619–637.
   Web of Science ®Google Scholar
• MacDonald, J., and Raphael, S. (2021), “Effect of Scaling Back Punishment on Racial and Ethnic Disparities in Criminal Case Outcomes,” Criminology & Public Policy, 19, 1139–1164.
   Web of Science ®Google Scholar
• McCandless, L. C., and Gustafson, P. (2017), “A Comparison of Bayesian and Monte Carlo Sensitivity Analysis for Unmeasured Confounding,” Statistics in Medicine, 36, 2887–2901.
   PubMed Web of Science ®Google Scholar
• McCandless, L. C., Gustafson, P., and Levy, A. (2007), “Bayesian Sensitivity Analysis for Unmeasured Confounding in Observational Studies,” Statistics in Medicine, 26, 2331–2347.
   PubMed Web of Science ®Google Scholar
• Munnell, A. H., Tootell, G. M. B., Browne, L. E., and McEneaney, J. (1996), “Mortgage Lending in Boston: Interpreting HMDA Data,” The American Economic Review, 86, 25–53.
   Web of Science ®Google Scholar
• Pearl, J. (2009), Causality, Cambridge: Cambridge University Press.
   Google Scholar
• Pearl, J. (2015), “Conditioning on Post-Treatment Variables,” Journal of Causal Inference, 3, 131–137.
   Google Scholar
• Pearl, J., Glymour, M., and Jewell, N. P. (2016), Causal Inference in Statistics: A Primer, Chichester: Wiley.
   Google Scholar
• Pierson, E., Simoiu, C., Overgoor, J., Corbett-Davies, S., Jenson, D., Shoemaker, A., Ramachandran, V., Barghouty, P., Shroff, R., Phillips, C., and Goel, S. (2020), “A Large-Scale Analysis of Racial Disparities in Police Stops Across the United States,” Nature Human Behaviour, 4, 736–745.
   PubMed Web of Science ®Google Scholar
• Rehavi, M. M., and Starr, S. B. (2014), “Racial Disparity in Federal Criminal Sentences,” Journal of Political Economy, 122, 1320–1354.
   Web of Science ®Google Scholar
• Richardson, T., and Robins, J. (2013), “Single World Intervention Graphs (SWIGs): A Unification of the Counterfactual and Graphical Approaches to Causality,” Technical report, Technical Report 128, Center for Statistics and the Social Sciences, Univ. Washington, Seattle, WA.
   Google Scholar
• Robertson, C., Baughman, S. B., and Wright, M. S. (2019), “Race and Class: A Randomized Experiment with Prosecutors,” Journal of Empirical Legal Studies, 16, 807–847.
   Web of Science ®Google Scholar
• Robins, J. (1986), “A New Approach to Causal Inference in Mortality Studies with a Sustained Exposure Period—Application to Control of the Healthy Worker Survivor Effect,” Mathematical Modelling, 7, 1393–1512.
   Web of Science ®Google Scholar
• Robins, J. M., Richardson, T. S., and Shpitser, I. (2020), “An Interventionist Approach to Mediation Analysis.”
   Google Scholar
• Rosenbaum, P. R., and Rubin, D. B. (1983a). “The Central Role of the Propensity Score in Observational Studies for Causal Effects,” Biometrika, 70, 41–55.
   Web of Science ®Google Scholar
• Rosenbaum, P. R., and Rubin, D. B. (1983b), “Assessing Sensitivity to an Unobserved Binary Covariate in an Observational Study with Binary Outcome,” Journal of the Royal Statistical Society, 45, 212–218.
   Google Scholar
• Sekhon, J. (2008), “The Neyman–Rubin Model of Causal Inference and Estimation via Matching Methods,” in The Oxford Handbook of Political Methodology, eds. J. Box-Steffensmeier, H. Brady, and D. Collier, Oxford: Oxford University Press.
   Google Scholar
• Spencer, K. B., Charbonneau, A. K., and Glaser, J. (2016), “Implicit Bias and Policing,” Social and Personality Psychology Compass, 10, 50–63.
   Web of Science ®Google Scholar
• Tsybakov, A. B. (2008), Introduction to Nonparametric Estimation, New York: Springer.
   Google Scholar
• Word, D., and Perkins, C. (1996), Building a Spanish Surname List for the 1990’s: A New Approach to an Old Problem, Washington, DC: Population Division, US Bureau of the Census.
   Google Scholar
• Word, D., Coleman, C., Nunziata, R., and Kominski, R. (2008), “Demographic Aspects of Surnames from Census 2000,” Technical report, U.S. Census Bureau Population Division. Available at http://www2.census.gov/topics/genealogy/2000surnames/surnames.pdf.
   Google Scholar
• Zhao, Q., Keele, L. J., Small, D. S., and Joffe, M. M. (2021), “A Note on Post-treatment Selection in Studying Racial Discrimination in Policing,” American Political Science Review, 1–14.
   Web of Science ®Google Scholar