Limitations of P-Values and R-squared for Stepwise Regression Building: A Fairness Demonstration in Health Policy Risk Adjustment

References

• Association for Computing Machinery (2017), “Statement on Algorithmic Transparency and Accountability,” available at https://www.acm.org/binaries/content/assets/public-policy/2017_usacm_statement_algorithms.pdf.
   Google Scholar
• Centers for Medicare & Medicaid Services (2016), “HHS-Operated Risk Adjustment Methodology Meeting Discussion Paper,” available at https://www.cms.gov/CCIIO/Resources/Forms-Reports-and-Other-Resources/Downloads/RA-March-31-White-Paper-032416.pdf.
   Google Scholar
• Centers for Medicare & Medicaid Services (2017), “Advance Notice of Methodological Changes for Calendar Year (CY) 2019 for the Medicare Advantage (MA) CMS-HCC Risk Adjustment Model,” available at https://www.cms.gov/Medicare/Health-Plans/MedicareAdvtgSpecRateStats/Downloads/Advance2019Part1.pdf.
   Google Scholar
• Chatfield, C. (1995), “Model Uncertainty, Data Mining and Statistical Inference,” Journal of the Royal Statistical Society, Series A, 158, 419–466. DOI: 10.2307/2983440.
   Web of Science ®Google Scholar
• Chouldechova, A. (2017), “Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction Instruments,” Big Data, 5, 153–163. DOI: 10.1089/big.2016.0047.
   PubMed Web of Science ®Google Scholar
• Draper, N., and Smith, H. (1966), Applied Regression Analysis. New York: Wiley.
   Google Scholar
• Efroymson, M. (1966), “Stepwise Regression—a Backward and Forward Look,” Presented at the Eastern Regional Meetings of the IMS, Florham Park, NJ.
   Google Scholar
• Ellis, R., Martins, B., and Rose, S. (2018), “Risk Adjustment for Health Plan Payment.” in McGuire, T. G., and Van Kleef, R. C. (eds.), Risk Adjustment, Risk Sharing and Premium Regulation in Health Insurance Markets: Theory and Practice, New York: Elsevier.
   Google Scholar
• Harrell, F. (2001), Regression Modeling Strategies: with Applications to Linear Models, Logistic Regression, and Survival Analysis., New York: Springer-Verlag.
   Google Scholar
• Hocking, R. (1976), “The Analysis and Selection of Variables in Linear Regression,” Biometrics, 32, 1–49. DOI: 10.2307/2529336.
   Web of Science ®Google Scholar
• Hu, L., and Chen, Y. (2017), “Fairness at Equilibrium in the Labor Market,” in Proceedings of Fairness, Accountability, and Transparency in Machine Learning, pp. 1–5.
   Google Scholar
• Kautter, J., and Pope, G. C. (2004), “CMS Frailty Adjustment Model,” Health Care Financing Review, 26, 1.
   PubMedGoogle Scholar
• Kusner, M. J., Loftus, J., Russell, C., and Silva, R. (2017), “Counterfactual Fairness,” in Advances in Neural Information Processing Systems, pp. 4069–4079.
   Google Scholar
• Layton, T. J., McGuire, T. G., Van Kleef, R. C., (2016), “Deriving Risk Adjustment Payment Weights to Maximize Efficiency of Health Insurance Markets,” NBER Working Paper 22642.
   Google Scholar
• Layton, T. J., Ellis, R. P., McGuire, T. G., and Van Kleef, R. C. (2017), “Measuring Efficiency of Health Plan Payment Systems in Managed Competition Health Insurance Markets,” Journal of Health Economics, 56, 237–255. DOI: 10.1016/j.jhealeco.2017.05.004.
   PubMed Web of Science ®Google Scholar
• Layton, T. J., Montz, E., and Shepard, M. (2018), “Health Plan Payment in U.S. Marketplaces: Regulated Competition with a Weak Mandate,” in McGuire, T.G., and Van Kleef, R.C. (eds.), Risk Adjustment, Risk Sharing and Premium Regulation in Health Insurance Markets: Theory and Practice, New York: Elsevier.
   Google Scholar
• Lum, K., and Isaac, W. (2016), “To Predict and Serve?” Significance, 13, 14–19. DOI: 10.1111/j.1740-9713.2016.00960.x.
   Google Scholar
• Mantel, N. (1970), “Why Stepdown Procedures in Variable Selection,” Technometrics, 12, 591–612.
   Web of Science ®Google Scholar
• McGuire, T. G. (2016), “Achieving Mental Health Care Parity Might Require Changes in Payment and Competition,” Health Affairs, 35, 1029–1035. DOI: 10.1377/hlthaff.2016.0012.
   Web of Science ®Google Scholar
• Miller, A. J. (2002), Subset Selection in Regression. Norwell, MA: CRC Press.
   Google Scholar
• Mitchell, S. (2017). “Fairness: Notation, Definitions, Data, Legality,” available at https://speak-statistics-to-power.github.io/fairness/old.html.
   Google Scholar
• Montz, E., Layton, T. J., Busch, A., Ellis, R., Rose, S., and McGuire T.G. (2016), “Risk Adjustment Simulation: Plans May Have Incentives to Distort Mental Health and Substance Use Coverage,” Health Affairs, 35, 1022–1028. DOI: 10.1377/hlthaff.2015.1668.
   Web of Science ®Google Scholar
• O'Malley, A. J., Zaslavsky, A. M., Elliott, M. N., Zaborski, L., and Cleary, P. D. (2005), “Case‐Mix Adjustment of the CAHPS® Hospital Survey,” Health Services Research, 40, 2162–2181. DOI: 10.1111/j.1475-6773.2005.00470.x.
   PubMed Web of Science ®Google Scholar
• Phillips, D. (2018), “At Veterans Hospital in Oregon, a Push for Better Ratings Puts Patients at Risk, Doctors Say,” New York Times, available at https://www.nytimes.com/2018/01/01/us/at-veterans-hospital-in-oregon-a-push-for-better-ratings-puts-patients-at-risk-doctors-say.html.
   Google Scholar
• Pope, G. C., Kautter, J., Ellis, R. P., Ash, A. S., Ayanian, J. Z., Ingber, M. J., Levy, J. M., and Robst, J. (2004), “Risk Adjustment of Medicare Capitation Payments Using The CMS-HCC Model,” Health Care Financing Review, 25, 119–141.
   PubMed Web of Science ®Google Scholar
• Pope, G. C., Kautter, J., Ingber, J. J., Freeman, S., Sekar, R., and Newhart, C. (2011), “Evaluation of the CMS-HCC Risk Adjustment Model,” available at http://www.nber.org/risk-adjustment/2011/Evaluation2011/Evaluation_Risk_Adj_Model_2011.pdf.
   Google Scholar
• Reyes J. (2016), “Technologists Must Do Better: Drexel Prof on the Ethics of Algorithms.” Technical.ly Philly, available at https://technical.ly/philly/2016/09/30/kris-unsworth-ethics-algorithms.
   Google Scholar
• Rose, S. (2016), “A Machine Learning Framework for Plan Payment Risk Adjustment." Health Services Research, 51, 2358–2374. DOI: 10.1111/1475-6773.12464.
   PubMed Web of Science ®Google Scholar
• Shahian, D.M., and Normand, S.L. (2008), “Comparison of ‘Risk-Adjusted’ Hospital Outcomes,” Circulation, 117, 1955–1963.
   PubMed Web of Science ®Google Scholar
• Shrestha, A., Bergquist, S., Montz, E., and Rose, S. (2017), “Mental Health Risk Adjustment with Clinical Categories and Machine Learning,” Health Services Research, advance online publication. doi: 10.1111/1475-6773.12818.
   Google Scholar
• Sinisi, S.E., and van der Laan, M.J. (2004), “Deletion/Substitution/Addition Algorithm in Learning with Applications In Genomics,” Statistical Applications in Genetics and Molecular Biology, 3, 1–38. DOI: 10.2202/1544-6115.1069.
   Google Scholar
• van der Laan, M. J., and Rose, S. (2010), “Statistics Ready for a Revolution: Next Generation of Statisticians Must Build Tools for Massive Data Sets,” Amstat News, 399, 38–39.
   Google Scholar
• Wasserstein, R. L., and Lazar, N. (2016), “The ASA’s Statement on p-values: Context, Process, and Purpose,” The American Statistician, 70, 129–133. DOI: 10.1080/00031305.2016.1154108.
   Web of Science ®Google Scholar
• Zemel, R., Wu, Y., Swersky, K., Pitassi, T., and Dwork, C. (2013), “Learning Fair Representations,” in International Conference on Machine Learning, pp. 325–333
   Google Scholar