Judges on the Benchmark: Developing a Sentencing Feedback System

References

• Abrams, D. S., Galbiati, R., Henry, E., Philippe, A. (2022). When in Rome… On Local Norms and Sentencing Decisions, Journal of the European Economic Association, 20(2), 700–738, https://doi.org/10.1093/jeea/jvab038
   Google Scholar
• Allcott, H. (2011). Social norms and energy conservation. Journal of Public Economics, 95(9-10), 1082–1095. https://doi.org/10.1016/j.jpubeco.2011.03.003
   Web of Science ®Google Scholar
• Alschuler, A. (1976). The trial judge’s role in plea bargaining, part I. Columbia Law Review, 76(7), 1059–1154. https://doi.org/10.2307/1121673
   Web of Science ®Google Scholar
• Anderson, J. M., Kling, J. R., & Stith, K. (1999). Measuring interjudge sentencing disparity: Before and after the federal sentencing guidelines. The Journal of Law and Economics, 42(S1), 271–308. https://doi.org/10.1086/467426
   Google Scholar
• Ashenfelter, O., Eisenberg, T., & Schwab, S. J. (1995). Politics and the judiciary: The influence of judicial background on case outcomes. The Journal of Legal Studies, 24(2), 257–281. https://doi.org/10.1086/467960
   Web of Science ®Google Scholar
• Bang, H., & Robins, J. M. (2005). Doubly robust estimation in missing data and causal inference models. Biometrics, 61(4), 962–973. https://doi.org/10.1111/j.1541-0420.2005.00377.x
   PubMed Web of Science ®Google Scholar
• Bang, H., & Robins, J. M. (2008), Correction to “Doubly Robust Estimation in Missing Data and Causal Inference Models,” by H. Bang and J. M. Robins; 61, 962–972, December 2005. Biometrics, 64(2), 650–650. https://doi.org/10.1111/j.1541-0420.2008.010
   Google Scholar
• Beijersbergen, K. A., Dirkzwager, A. J., & Nieuwbeerta, P. (2016). Reoffending after release: Does procedural justice during imprisonment matter? Criminal Justice and Behavior, 43(1), 63–82. https://doi.org/10.1177/0093854815609643
   Web of Science ®Google Scholar
• Berk, R. (2010). An introduction to statistical learning from a regression perspective. In A. R. Piquero, & D. Weisburd, Handbook of quantitative criminology (pp. 725–740). Springer Verlag.
   Google Scholar
• Bogan, K., & Factor, D. (1997). Oregon guideline, 1989-1994. In M. Tonry, & K. Hatlestad, Sentencing reform in crowded times (pp. 49–57). Oxford University Press.
   Google Scholar
• Bornstein, A., Marcus, A., Curtis, R., Rivera, S., & Swaner, R. (2001). Disrespect and the experience of injustice. Annual Review of Psychology, 52(1), 527–553.
   PubMedGoogle Scholar
• Bornstein, A., Marcus, A., Curtis, R., Rivera, S., & Swaner, R. (2016). Tell it to the judge: Procedural justice and a community court in Brooklyn. PoLAR: Political and Legal Anthropology Review, 39(2), 206–225. https://doi.org/10.1111/plar.12190
   Web of Science ®Google Scholar
• Britt, C. L. (2009). Modeling the distribution of sentence length decisions under a guidelines system: An application of quantile regression models. Journal of Quantitative Criminology, 25(4), 341–370. https://doi.org/10.1007/s10940-009-9066-x
   Web of Science ®Google Scholar
• Brody, D. (2008). The use of judicial performance evaluations to enhance judicial accountability, judicial independence, and public trust. Denver Law Review, 86, 1–42.
   Web of Science ®Google Scholar
• Cohen, A., & Yang, C. S. (2019). Judicial politics and sentencing decisions. American Economic Journal: Economic Policy, 11(1), 160–191. https://doi.org/10.1257/pol.20170329
   Web of Science ®Google Scholar
• Depew, B., Eren, O., & Mocan, N. (2017). Judges, juveniles, and in-group bias. The Journal of Law and Economics, 60(2), 209–239. https://doi.org/10.1086/693822
   Web of Science ®Google Scholar
• Dippel, C., & Poyker, M. (2019). How common are electoral cycles in criminal sentencing? National Bureau of Economic Research, (No. w25716), 1–19.
   Google Scholar
• Dollar, C. B., Ray, B., Hudson, M. K., & Hood, B. J. (2018). Examining changes in procedural justice and their influence on problem-solving court outcomes. Behavioral Sciences & the Law, 36(1), 32–45. https://doi.org/10.1002/bsl.2329
   PubMed Web of Science ®Google Scholar
• Emeriau, M. (2019). Learning to be unbiased: Evidence from the French Asylum Office. Working paper (pp. 1–63).
   Google Scholar
• Eren, O., & Mocan, N. (2018). Emotional judges and unlucky juveniles. American Economic Journal: Applied Economics, 10(3), 171–205. https://doi.org/10.1257/app.20160390
   Web of Science ®Google Scholar
• Frase, R. S. (2019). Forty years of American sentencing guidelines: What have we learned? Crime and Justice, 48, 79–135. https://doi.org/10.1086/701503
   Web of Science ®Google Scholar
• Gazal-Ayal, O., & Sulitzeanu-Kenan, R. (2010). Let my people go: Ethnic in-group bias in judicial decisions-evidence from a randomized natural experiment. Journal of Empirical Legal Studies, 7(3), 403–428. https://doi.org/10.1111/j.1740-1461.2010.01183.x
   Web of Science ®Google Scholar
• Grffin, E., Rushin, S., & Colquitt, J. (2019). The effects of voluntary and presumptive sentencing guidelines. Texas Law Review, 98(1), 1–66.
   Web of Science ®Google Scholar
• Hastie, T., Tibshirani, R., & Friedman, J. (2008). The elements of statistical learning (2nd ed.). Springer.
   Google Scholar
• Haynes, S. H. (2011). The effects of victim-related contextual factors on the criminal justice system. Crime and Delinquency, 57(2), 298–328.
   Web of Science ®Google Scholar
• Haynes, S. H., Ruback, B., & Cusick, G. R. (2010). Courtroom workgroups and sentencing: The effects of similarity, proximity, and stability. Crime & Delinquency, 56(1), 126–161. https://doi.org/10.1177/0011128707313787
   Web of Science ®Google Scholar
• Henderson, K. S., Fountain, E. N., Redlick, A. D., & Cantone, J. A. (2022). Judicial involvement in plea-bargaining. Psychology, Public Policy, and Law, 28(3), 1–18.
   Web of Science ®Google Scholar
• Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2007). Matching as nonparametric preprocessing for reducing Modle dependence in parametric causal inference. Political Analysis, 15(3), 199–236. https://doi.org/10.1093/pan/mpl013
   Web of Science ®Google Scholar
• Huber, G. A., & Gordon, S. C. (2004). Accountability and coercion: Is justice blind when it runs for office? American Journal of Political Science, 48(2), 247–263. https://doi.org/10.2307/1519881
   Web of Science ®Google Scholar
• Institute for the Advancement of the American Legal System. (2021). Judicial evaluation performance around the country. https://iaals.du.edu/projects/judicial-performance-evaluation/jpe-around-country
   Google Scholar
• Johnson, B. D. (2006). The multi-level context of criminal sentencing: Integrating judge- and county-level influences. Criminology, 44(2), 259–298. https://doi.org/10.1111/j.1745-9125.2006.00049.x
   Web of Science ®Google Scholar
• Johnson, B. D. (2014). Judges on trial: A reexamination of judicial race and gender effects across modes of conviction. Criminal Justice Policy Review, 25(2), 159–184. https://doi.org/10.1177/0887403412463933
   Google Scholar
• Johnson, B. D., & DiPietro, S. M. (2012). The power of diversion: Intermediate sanctions and sentencing disparity under presumptive guidelines. Criminology, 50(3), 811–850. https://doi.org/10.1111/j.1745-9125.2012.00279.x
   Web of Science ®Google Scholar
• Kautt, P. M., & Mueller-Johnson, K. (2009). Cross-jurisdictional disposition variability under sentencing guidelines: The example of equivalent sex offenses. Criminal Justice Review, 34(3), 350–381. https://doi.org/10.1177/0734016808328673
   Google Scholar
• Keele, L., Ben-Michael, E., Feller, A., Kelz, R., Miratrix, L. (2021). Hospital quality risk standardization via approximate balancing weights. https://arxiv.org/abs/2007.09056
   Google Scholar
• King, N. J., & Wright, R. F. (2016). The invisible revolution in plea bargaining: Managerial judging and judicial participation in negotiations. Texas Law Review, 95, 325–397.
   Web of Science ®Google Scholar
• Kourlis, R. L., & Singer, J. M. (2007). Using judicial performance evaluations to promote judicial accountability. Judicature, 90(5), 200–207.
   Web of Science ®Google Scholar
• Kutateladze, B. L., Andiloro, N. R., Johnson, B. D., & Spohn, C. C. (2014). Cumulative disadvantage: Examining racial and ethnic disparity in prosecutions and sentencing. Criminology, 52(3), 514–551. https://doi.org/10.1111/1745-9125.12047
   Web of Science ®Google Scholar
• Lee, B. K., Lessler, J., & Stuart, E. A. (2010). Improving propensity score weighting using machine learning. Statistics in Medicine, 29(3), 337–346. https://doi.org/10.1002/sim.3782
   PubMed Web of Science ®Google Scholar
• Leibovitch, A. (2016). Relative judgments. The Journal of Legal Studies, 45(2), 281–330. https://doi.org/10.1086/687376
   Web of Science ®Google Scholar
• Levi, D. F., & Gulati, M. (2009). Judging measures. UMKC Law Review, 77, 381–413.
   Google Scholar
• Lim, C. S. (2015). Media influence on courts: Evidence from civil case adjudication. American Law and Economics Review, 17(1), 87–126. https://doi.org/10.1093/aler/ahv005
   Web of Science ®Google Scholar
• Lim, C. S., Silveira, B. S., & Snyder, J. M. (2016). Do judges’ characteristics matter? Ethnicity, gender, and partisanship in Texas State Trial Courts. American Law and Economics Review, 18(2), 302–357. https://doi.org/10.1093/aler/ahw006
   Web of Science ®Google Scholar
• Lim, C. S., Snyder, J. M., & Strömberg, D. (2015). The judge, the politician, and the press: Newspaper coverage and criminal sentencing across electoral systems. American Economic Journal: Applied Economics, 7(4), 103–135. https://doi.org/10.1257/app.20140111
   Web of Science ®Google Scholar
• Lynch, M. (2011). Mass incarceration, legal change, and locale: Understanding and remediating American penal. Criminology & Public Policy, 10(3), 673–698. https://doi.org/10.1111/j.1745-9133.2011.00733.x
   Web of Science ®Google Scholar
• McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004). Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychological Methods, 9(4), 403–425. https://doi.org/10.1037/1082-989X.9.4.403
   PubMed Web of Science ®Google Scholar
• Mindock, M. R. (2019). Race, fairness, and co-determination in criminal sentencing: Evidence from sentencing cohorts in Pennsylvania. Working paper (pp. 1–42).
   Google Scholar
• Mitchell, K. L. (2017). State sentencing guidelines: A garden full of variety. Federal Probation, 81, 28–36.
   Google Scholar
• Mustard, D. B. (2001). Racial, ethnic, and gender disparities in sentencing: Evidence from the U.S. Federal Courts. The Journal of Law and Economics, (1)44, 285–314. https://doi.org/10.1086/320276
   Web of Science ®Google Scholar
• Paternoster, R., Brame, R., Bachman, R., & Sherman, L. W. (1997). Do fair procedures matter? The effect of procedural justice on spouse assault. Law & Society Review, 31(1), 163–204. https://doi.org/10.2307/3054098
   Web of Science ®Google Scholar
• Pennsylvania Code. (2022). PART H. Plea procedures. https://www.pacodeandbulletin.gov/Display/pacode?file=/secure/pacode/data/234/chapter5/s590.html&d=reduce
   Google Scholar
• Philippe, A., & Ouss, A. (2018). “No hatred or malice, fear or affection”: Media and sentencing. Journal of Political Economy, 126(5), 2134–2178. https://doi.org/10.1086/699210
   Web of Science ®Google Scholar
• Pina-Sanchez, J., Grech, D., Brunton-Smith, I., & Sferopoulos, D. (2019). Exploring the origin of sentencing disparities in the Crown Court: Using text mining techniques to differentiate between court and judge disparities. Social Science Research, 84, 102343. https://doi.org/10.1016/j.ssresearch.2019.102343
   PubMed Web of Science ®Google Scholar
• Ridgeway, G., & MacDonald, J. M. (2009). Doubly robust internal benchmarking and false discovery rates for detecting racial bias in police stops. Journal of the American Statistical Association, 104(486), 661–668. https://doi.org/10.1198/jasa.2009.0034
   Web of Science ®Google Scholar
• Ridgeway, G., & MacDonald, J. M. (2014). A method for internal benchmarking of criminal justice system performance. Crime & Delinquency, 60(1), 145–162. https://doi.org/10.1177/0011128713514802
   Web of Science ®Google Scholar
• Ridgeway, G., Moyer, R. A., & Bushway, S. D. (2020). Sentencing scorecards: Reducing racial disparities in prison sentences at their source. Criminology & Public Policy, (4)19, 1113–1138. https://doi.org/10.1111/1745-9133.12529
   Web of Science ®Google Scholar
• Ridgeway, G. (2019). fastDR: R package for fast and easy doubly robust estimation of treatments effects. https://github.com/gregridgeway/fastDR
   Google Scholar
• Robbennolot, J. K. (2005). Evaluating juries by comparison to judges: A benchmark for judging? Florida State University Law Review, 32(2), 1–44.
   Google Scholar
• Ryan, J. P., & Alfini, J. J. (1979). Trial judges’ participation in plea bargaining: An empirical perspective. Law & Society Review, 13(2), 479–507. https://doi.org/10.2307/3053265
   Web of Science ®Google Scholar
• Schanzenbach, M. (2018). Racial disparities, judge characteristics, and standards of review in sentencing. Journal of Institutional and Theoretical Economics, (1)171, 27–46. https://doi.org/10.1628/093245615X14188909230019
   Google Scholar
• Scott, R. W. (2010). Inter-judge sentencing disparity after booker: A first look. Stanford Law Review, 63(1), 1–66.
   Web of Science ®Google Scholar
• Shayo, M., & Zussman, A. (2011). Judicial ingroup bias in the shadow of terrorism. The Quarterly Journal of Economics, 126(3), 1447–1484. https://doi.org/10.1093/qje/qjr022
   Web of Science ®Google Scholar
• Sherman, L. W. (1993). Defiance, deterrence, and irrelevance: A theory of the criminal sanction. Journal of Research in Crime and Delinquency, 30(4), 445–473. https://doi.org/10.1177/0022427893030004006
   Web of Science ®Google Scholar
• Sprott, J. B., & Greene, C. (2010). Trust and confidence in the courts: Does the quality of treatment young offenders receive affect their views of the courts? Crime & Delinquency, 56(2), 269–289. https://doi.org/10.1177/0011128707308176
   Web of Science ®Google Scholar
• Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1), 267–288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
   Web of Science ®Google Scholar
• Tiede, L., Carp, R., & Manning, K. L. (2010). Judicial attributes and sentencing-deviation case: Do sex, race, and politics matter? Justice System Journal, 31(3), 249–272. https://doi.org/10.1080/0098261X.2010.10767970
   Web of Science ®Google Scholar
• Tonry, M. (2013). Sentencing in America, 1975-2025. Crime and Justice, 42(1), 141–198. https://doi.org/10.1086/671134
   Google Scholar
• Transactional Records Access Clearinghouse. (2023). The development of judge-specific federal sentencing data at TRAC. https://trac.syr.edu/judges/aboutData.html#f3
   Google Scholar
• Turner, J. I. (2006). Judicial participation in plea negotiations: A comparative view. The American Journal of Comparative Law, 54(1), 199–267. https://doi.org/10.1093/ajcl/54.1.199
   Web of Science ®Google Scholar
• Tyler, T. R. (2001). Trust and law abidingness: A proactive model of social regulation. Boston University Law Review, 81(2), 361–406.
   Web of Science ®Google Scholar
• Tyler, T. R., Lawrence, S., Strang, H., Barnes, G. C., & Woods, D. (2007). Reintegrative shaming, procedural justice, and recidivism: The engagement of offenders’ psychological mechanisms in the Canberra RISE drinking-and-driving experiment. Law & Society Review, 41(3), 553–586. https://doi.org/10.1111/j.1540-5893.2007.00314.x
   Web of Science ®Google Scholar
• Ulmer, J. T., & Bradley, M. S. (2006). Variation in trial penalties among serious violent offenses. Criminology, 44(3), 631–670. https://doi.org/10.1111/j.1745-9125.2006.00059.x
   Web of Science ®Google Scholar
• Ulmer, J. T., & Johnson, B. (2004). Sentencing in context: A multilevel analysis. Criminology, 42(1), 137–178. https://doi.org/10.1111/j.1745-9125.2004.tb00516.x
   Web of Science ®Google Scholar
• United States Government Accountability Office. (2017). Social Security Disability: Additional measures and evaluation needed to enhance accuracy and consistency of hearings decisions.
   Google Scholar
• Vuolo, M., Wright, B. R., & Lindsay, S. L. (2019). Inmate responses to experiences with court system procedural and distributive justice. The Prison Journal, 99(6), 725–747. https://doi.org/10.1177/0032885519877401
   Web of Science ®Google Scholar
• Weisberg, F. H., & Hunt, K. S. (2007). Voluntary sentencing guidelines in the District of Columbia: Results of the pilot program. Federal Sentencing Reporter, 19(3), 208–218. https://doi.org/10.1525/fsr.2007.19.3.208
   Google Scholar
• Welch, S., Combs, M., & Gruhl, J. (1988). Do black judges make a difference? American Journal of Political Science, 32(1), 126–136. https://doi.org/10.2307/2111313
   Web of Science ®Google Scholar
• Yang, C. S. (2014). Have inter-judge sentencing disparities increased in an advisory guideline regime? Evidence from Booker. New York University Law Review, 89(4), 1268–1342.
   Web of Science ®Google Scholar
• Yang, C. S. (2015). Free at last? Judicial discretion and racial disparities in federal sentencing. The Journal of Legal Studies, 44(1), 75–111. https://doi.org/10.1086/680989
   Web of Science ®Google Scholar
• Zhao, P., & Yu, B. (2007). Stagewise Lasso. Journal of Machine Learning Research, 8, 2701–2726.
   Web of Science ®Google Scholar