Biased Estimation in Regression: An Evaluation Using Mean Squared Error

References

• Baranchik , Alvin J. 1970 . “A Family of Minimax Estimators of the Mean of a Multivariate Normal Distribution,” . Annals of Mathematical Statistics , 41 : 642 – 5 .
   Google Scholar
• Box , George E. P. and Muller , Mervin E. 1958 . “A Note on the Generation of Random Normal Deviates,” . Annals of Mathematical Statistics , 29 : 610 – 1 .
   Google Scholar
• Cochran , William G. 1963 . Sampling Techniques , New York : John Wiley & Sons .
   Google Scholar
• Conniffe , D. and Stone , Joan . 1973 . “A Critical View of Ridge Regression,” . The Statistician , 22 : 181 – 7 .
   Google Scholar
• Stone , Joan . 1975 . “A Reply to Smith and Goldstein,” . The Statistician , 24 : 67 – 8 .
   Google Scholar
• Dempster , Arthur P. 1973 . “Alternatives to Least Squares in Multiple Regression,” . In Multivariate Statistical Inference , Edited by: Kabe , D. G. and Gupta , R. P. Amsterdam : North Holland Publishing Co. .
   Google Scholar
• Schatzoff , Martin and Wermuth , Nanny . 1977 . “A Simulation Study of Alternatives to Ordinary Least Squares,” . Journal of the American Statistical Association , 72 : 77 – 90 .
   Web of Science ®Google Scholar
• Golder , E. R. 1976 . “The Spectral Test for the Evaluation of Congruential Pseudo-Random Generators,” . Applied Statistics , 25 : 173 – 80 .
   Google Scholar
• Goldstein , M. and Smith , Adrian F. M. 1974 . “Ridge-Type Estimators for Regression Analysis,” . Journal of the Royal Statistical Society , 36 : 284 – 91 . Ser. B
   Google Scholar
• Gunst , Richard F. and Mason , Robert L. 1976 . “Generalized Mean Squared Error Properties of Regression Estimators,” . Communications in Statistics , A5 : 1501 – 8 .
   Google Scholar
• Gunst , Richard F. , Mason , Robert L. , Webster , John T. and Mason , Robert L. 1976 . “A Comparison of Least Squares and Latent Root Regression Estimators,” . Technometrics , 18 : 75 – 83 .
   Web of Science ®Google Scholar
• Hawkins , Douglas M. 1973 . “On the Investigation of Alternative Regressions by Principal Component Analysis,” . Applied Statistics , 22 : 275 – 86 .
   Web of Science ®Google Scholar
• Hocking , Ronald R. 1976 . “The Analysis and Selection of Variables in Linear Regression,” . Biometrics , 32 : 1 – 50 .
   Web of Science ®Google Scholar
• Hocking , Ronald R. , Speed , F. M. and Lynn , M. T. 1976 . “A Class of Biased Estimators in Linear Regression,” . Technometrics , 18 : 425 – 38 .
   Web of Science ®Google Scholar
• Hoerl , Arthur E. and Kennard , Robert W. 1970a . “Ridge Regression: Biased Estimation for Nonorthogonal Problems,” . Technometrics , 12 : 55 – 67 .
   Web of Science ®Google Scholar
• Kennard , Robert W. 1970b . “Ridge Regression: Applications to Nonorthogonal Problems,” . Technometrics , 12 : 69 – 82 .
   Web of Science ®Google Scholar
• Kennard , Robert W. 1976 . “Ridge Regression: Iterative Estimation of the Biasing Parameter,” . Communications in Statistics , A5 : 77 – 88 .
   Google Scholar
• Kennard , Robert W. , Kennard , Robert W. and Baldwin , Kent F. 1975 . “Ridge Regression: Some Simulations,” . Communications in Statistics , 4 : 105 – 23 .
   Google Scholar
• International Business Machines . 1970 . System/360 Scientific Subroutine Package (360A-CM-O3X) , New York : IBM Technical Publications Department .
   Google Scholar
• James , W. and Stein , Charles . 1961 . “Estimation with Quadratic Loss,” . Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability , 1 : 361 – 79 .
   Google Scholar
• Knuth , Donald E. 1969 . The Art of Computer Programming , Vol. 2 , Reading , Mass. : Addison-Wesley Publishing Co. .
   Google Scholar
• Lawless , J. F. and Wang , P. 1976 . “A Simulation of Ridge and Other Regression Estimators,” . Communications in Statistics , A5 : 307 – 23 .
   Google Scholar
• Lott , William F. 1973 . “Optimal Set of Principal Component Restrictions on a Least Squares Regression,” . Communications in Statistics , 2 : 449 – 64 .
   Google Scholar
• Lowerre , James M. 1974 . “On the Mean Square Error of Parameter Estimates for Some Biased Estimators,” . Technometrics , 16 : 461 – 7 .
   Web of Science ®Google Scholar
• Mallows , Colin L. 1973 . “Some Comments on Cp,” . Technometrics , 15 : 661 – 75 .
   Web of Science ®Google Scholar
• Mansfield , Edward R. 1975 . “Principal Component Approach to Handling Multicollinearity in Regression Analysis,” , Ph.D. dissertation Dallas , Texas. : Department of Statistics, Southern Methodist University .
   Google Scholar
• Mansfield , Edward R. , Webster , John T. and Gunst , Richard F. 1977 . “An Analytic Variable Selection Technique for Principal Component Regression,” . Applied Statistics , 26 to appear
   Google Scholar
• Marquardt , Donald W. 1970 . “Generalized Inverses, Ridge Regression, Biased Linear Estimation, and Nonlinear Estimation,” . Technometrics , 12 : 591 – 612 .
   Web of Science ®Google Scholar
• Mason , Robert L. , Gunst , Richard F. and Webster , John T. 1975 . “Regression Analysis and Problems of Multicollinearity,” . Communications in Statistics , 4 : 277 – 92 .
   Google Scholar
• Massy , William F. 1965 . “Principal Component Regression in Exploratory Statistical Research,” . Journal of the American Statistical Association , 60 : 234 – 56 .
   Web of Science ®Google Scholar
• Mayer , Lawrence S. and Willke , Thomas A. 1973 . “On Biased Estimation in Linear Models,” . Technometrics , 15 : 497 – 508 .
   Web of Science ®Google Scholar
• McDonald , Gary C. and Galarneau , Diane I. 1975 . “A Monte Carlo Evaluation of Some Ridge-Type Estimators,” . Journal of the American Statistical Association , 70 : 407 – 16 .
   Web of Science ®Google Scholar
• Nelder , J. A. 1972 . “Discussion of a Paper by D.V. Lindley and A.F.M. Smith,” . Journal of the Royal Statistical Society , 34 : 18 – 20 . Ser. B
   Google Scholar
• Newhouse , Joseph P. and Oman , Samuel D. 1971 . “An Evaluation of Ridge Estimators,” , Santa Monica , Calif. : The Rand Corporation . Technical Report No. R-716-PR
   Google Scholar
• Sclove , Stanley L. 1968 . “Improved Estimators for Coefficients in Linear Regression,” . Journal of the American Statistical Association , 63 : 596 – 606 .
   Web of Science ®Google Scholar
• Sidik , Stephen M. 1975 . “Comparison of Some Biased Estimation Methods (Including Ordinary Subset Regression) in the Linear Model,” , Cleveland : National Aeronautics and Space Administration, Lewis Research Center . Technical Report No. NASA TN D-7932
   Google Scholar
• Smith , Adrian F. M. and Goldstein , M. 1975 . “Ridge Regression: Some Comments on a Paper of Conniffe and Stone,” . The Statistician , 24 : 61 – 6 .
   Google Scholar
• Stein , Charles . 1960 . “Multiple Regression,” . In Contributions to Probability and Statistics: Essays in Honor of Harold Hotelling , Edited by: Olkin , Ingrim . Stanford , Calif. : Stanford University Press .
   Google Scholar
• Theobald , C. M. 1974 . “Generalizations of Mean Square Error Applied to Ridge Regression,” . Journal of the Royal Statistical Society , 36 : 103 – 6 . Ser. B
   Google Scholar
• Webster , John T. , Gunst , Richard F. and Mason , Robert L. 1974 . “Latent Root Regression Analysis,” . Technometrics , 16 : 513 – 22 .
   Web of Science ®Google Scholar