Generalized Fiducial Inference for Ultrahigh-Dimensional Regression

Abstract

In recent years, the ultrahigh-dimensional linear regression problem has attracted enormous attention from the research community. Under the sparsity assumption, most of the published work is devoted to the selection and estimation of the predictor variables with nonzero coefficients. This article studies a different but fundamentally important aspect of this problem: uncertainty quantification for parameter estimates and model choices. To be more specific, this article proposes methods for deriving a probability density function on the set of all possible models, and also for constructing confidence intervals for the corresponding parameters. These proposed methods are developed using the generalized fiducial methodology, which is a variant of Fisher’s controversial fiducial idea. Theoretical properties of the proposed methods are studied, and in particular it is shown that statistical inference based on the proposed methods will have correct asymptotic frequentist property. In terms of empirical performance, the proposed methods are tested by simulation experiments and an application to a real dataset. Finally, this work can also be seen as an interesting and successful application of Fisher’s fiducial idea to an important and contemporary problem. To the best of the authors’ knowledge, this is the first time that the fiducial idea is being applied to a so-called “large p small n” problem. A connection to objective Bayesian model selection is also discussed.

• Confidence intervals
• Large p small n
• Minimum description length principle
• Uncertainty quantification
• Variability estimation

Additional information

Notes on contributors

Randy C. S. Lai

Randy C. S. Lai (E-mail: [email protected]) is Ph.D. student

Jan Hannig

Thomas C. M. Lee (E-mail: [email protected]) is Professor, Department of Statistics, University of California at Davis, Davis, CA 95616.

Thomas C. M. Lee

Jan Hannig is Professor, Department of Statistics and Operations Research, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599-3260 (E-mail: [email protected] ).