Improving Predictions When Interest Focuses on Extreme Random Effects

Abstract

Statistical models that generate predicted random effects are widely used to evaluate the performance of and rank patients, physicians, hospitals and health plans from longitudinal and clustered data. Predicted random effects have been proven to outperform treating clusters as fixed effects (essentially a categorical predictor variable) and using standard regression models, on average. These predicted random effects are often used to identify extreme or outlying values, such as poorly performing hospitals or patients with rapid declines in their health. When interest focuses on the extremes rather than performance on average, there has been no systematic investigation of best approaches. We develop novel methods for prediction of extreme values, evaluate their performance, and illustrate their application using data from the Osteoarthritis Initiative to predict walking speed in older adults. The new methods substantially outperform standard random and fixed-effects approaches for extreme values.

Keywords:

• Best linear unbiased prediction
• Mean squared error of prediction
• Profiling

View correction statement:

Correction

Supplementary material

This supplemental material contains two files, a Stata .do file and a Stata dataset that reproduce the Osteoarthritis Initiative walking speed analysis and figure reported in the manuscript.