101
Views
102
CrossRef citations to date
0
Altmetric
Theory and Method

Biased Estimation in Regression: An Evaluation Using Mean Squared Error

&
Pages 616-628 | Received 01 Feb 1976, Published online: 05 Apr 2012

Keep up to date with the latest research on this topic with citation updates for this article.

Read on this site (36)

Mohamed R. Abonazel & Ibrahim M. Taha. (2023) Beta ridge regression estimators: simulation and application. Communications in Statistics - Simulation and Computation 52:9, pages 4280-4292.
Read now
A. F. Roldán López de Hierro, C. García & R. Salmerón. (2021) Analysis of the condition number in the raise regression. Communications in Statistics - Theory and Methods 50:24, pages 6195-6210.
Read now
Sajid Ali, Himmad Khan, Ismail Shah, Muhammad Moeen Butt & Muhammad Suhail. (2021) A comparison of some new and old robust ridge regression estimators. Communications in Statistics - Simulation and Computation 50:8, pages 2213-2231.
Read now
Antonio Lepore, Biagio Palumbo & Christian Capezza. (2019) Orthogonal LS-PLS approach to ship fuel-speed curves for supporting decisions based on operational data. Quality Engineering 31:3, pages 386-400.
Read now
Guanghan Liu & Steven Piantadosi. (2017) Ridge estimation in generalized linear models and proportional hazards regressions. Communications in Statistics - Theory and Methods 46:23, pages 11466-11479.
Read now
A. V. Dorugade. (2014) New ridge parameters for ridge regression. Journal of the Association of Arab Universities for Basic and Applied Sciences 15:1, pages 94-99.
Read now
Gülin Tabakan. (2013) Performance of the difference-based estimators in partially linear models. Statistics 47:2, pages 329-347.
Read now
M. Revan Özkale. (2012) Combining the unrestricted estimators into a single estimator and a simulation study on the unrestricted estimators. Journal of Statistical Computation and Simulation 82:5, pages 653-688.
Read now
Feras Sh. M. Batah, M. Revan Özkale & S. D. Gore. (2009) Combining Unbiased Ridge and Principal Component Regression Estimators. Communications in Statistics - Theory and Methods 38:13, pages 2201-2209.
Read now
B. M. Golam Kibria. (2003) Performance of Some New Ridge Regression Estimators. Communications in Statistics - Simulation and Computation 32:2, pages 419-435.
Read now
AliS. Hadi & RobertF. Ling. (1998) Some Cautionary Notes on the Use of Principal Components Regression. The American Statistician 52:1, pages 15-19.
Read now
Lakshman Krishnamurthi & Arvind Rangaswamy. (1994) The Statistical Properties of the Equity Estimator: A Reply. Journal of Business & Economic Statistics 12:2, pages 149-153.
Read now
PaulH. Garthwaite. (1994) An Interpretation of Partial Least Squares. Journal of the American Statistical Association 89:425, pages 122-127.
Read now
Jeffrey L. Pliskin. (1990) The Mean Squared Error of the Generalized Ridge Regression Estimator and the Orientation of β. Communications in Statistics - Simulation and Computation 19:4, pages 1477-1484.
Read now
Michael D. Conerly & J.Michael Hardin. (1990) A comparison of biased regression estimators using a pitman nearness criterion. Journal of Statistical Computation and Simulation 34:2-3, pages 75-95.
Read now
Wonwoo Lee & Jeffrey B. Birch. (1988) Fractional principal components regression: a general approach to biased estimators. Communications in Statistics - Simulation and Computation 17:3, pages 713-727.
Read now
Han Bin Kang & Alan Reichert. (1987) An Evaluation of Alternative Estimation Techniques and Functional Forms in Developing Statistical Appraisal Models. Journal of Real Estate Research 2:1, pages 1-29.
Read now
RogerW. Hoer1, JohnH. Schuenemeyer & ArthurE. Hoer1. (1986) A Simulation of Biased Estimation and Subset Selection Regression Techniques. Technometrics 28:4, pages 369-380.
Read now
Robert L. Mason. (1986) Latent root regression: a biased regression methodology for use with collinear predictor variables. Communications in Statistics - Theory and Methods 15:9, pages 2651-2678.
Read now
Yih‐Wu Liu & RichardH. Bee. (1983) Ridge regression: A multivariate analysis of criminal activity. Sociological Spectrum 3:2, pages 143-157.
Read now
Tsushung A. Hua & Richard F. Gunst. (1983) Generalized ridge regression: a note on negative ridge parameters. Communications in Statistics - Theory and Methods 12:1, pages 37-45.
Read now
Song-gui Wang. (1982) On biased linear estimators in models with arbitrary rank. Communications in Statistics - Theory and Methods 11:14, pages 1571-1581.
Read now
Norman S. Matloff. (1982) James - stein regression estimation in a prediction context. Communications in Statistics - Simulation and Computation 11:5, pages 589-601.
Read now
Erkki P. Liski. (1982) A test of the mean square error criterion for shrinkage estimators. Communications in Statistics - Simulation and Computation 11:5, pages 543-562.
Read now
J.F. Lawless. (1981) Mean Squared Error Properties of Generalized Ridge Estimators. Journal of the American Statistical Association 76:374, pages 462-466.
Read now
Diane Galarneau Gibbons. (1981) A Simulation Study of Some Ridge Estimators. Journal of the American Statistical Association 76:373, pages 131-139.
Read now
BeneeF. Swindel. (1981) Geometry of Ridge Regression Illustrated. The American Statistician 35:1, pages 12-15.
Read now
Mark D. Pagel. (1981) Comment on hoerl and kennard's ridge regression simulation methodology. Communications in Statistics - Theory and Methods 10:22, pages 2361-2367.
Read now
R. Craig Van Nostrand. (1980) Comment. Journal of the American Statistical Association 75:369, pages 92-94.
Read now
J.W. White & R.F. Gunst. (1979) Latent Root Regression: Large Sample Analysis. Technometrics 21:4, pages 481-488.
Read now
NormanR. Draper & R. Craig Van Nostrand. (1979) Ridge Regression and James-Stein Estimation: Review and Comments. Technometrics 21:4, pages 451-466.
Read now
Amitava Mitra & Robert F Ling. (1979) A monte carlo comparison of some ridge and other biased estimators. Journal of Statistical Computation and Simulation 9:3, pages 195-215.
Read now
WilliamJ. Kennedy$suffix/text()$suffix/text(). (1979) New Developments in Statistical Computing. The American Statistician 33:3, pages 159-160.
Read now
RichardF. Gunst & RobertL. Mason. (1979) Some Considerations in the Evaluation of Alternate Prediction Equations. Technometrics 21:1, pages 55-63.
Read now
Richard F. Gunst. (1979) An approach to the programming of biased regression algorithms. Communications in Statistics - Simulation and Computation 8:2, pages 151-159.
Read now
DeanW. Wichern & GilbertA. Churchill. (1978) A Comparison of Ridge Estimators. Technometrics 20:3, pages 301-311.
Read now

Articles from other publishers (66)

Aamir Shahzad, Muhammad Amin, Walid Emam & Muhammad Faisal. (2024) New ridge parameter estimators for the quasi-Poisson ridge regression model. Scientific Reports 14:1.
Crossref
Yukun Zheng, Ruyue Sun, Fengming Li, Yixiang Liu, Rui Song & Yibin Li. (2023) Parameter identification and position control for helical hydraulic rotary actuators based on particle swarm optimization. Mechatronics 94, pages 103006.
Crossref
Asia Batool, Muhammad Amin & Ahmed Elhassanein. (2023) On the performance of some new ridge parameter estimators in the Poisson-inverse Gaussian ridge regression. Alexandria Engineering Journal 70, pages 231-245.
Crossref
Min Tsao. (2022) Group least squares regression for linear models with strongly correlated predictor variables. Annals of the Institute of Statistical Mathematics 75:2, pages 233-250.
Crossref
Dilek KÜÇÜK MATCI. (2023) Estimation of Urban Area Change in Eskişehir Province Using Remote Sensing Data and Machine Learning Algorithms. International Journal of Environment and Geoinformatics 10:1, pages 146-151.
Crossref
Jiyong Kim & Minseo Park. (2023) A Study on ML-Based Sleep Score Model Using Lifelog Data. Applied Sciences 13:2, pages 1043.
Crossref
Mowafaq Muhammed Al-Kassab & Salisu Ibrahim. 2023. Mathematics and Computation. Mathematics and Computation 183 194 .
Bahjat Fakieh, Abdullah S. AL-Malaise AL-Ghamdi & Mahmoud Ragab. (2022) The Effect of Utilizing Business Model Canvas on the Satisfaction of Operating Electronic Business. Complexity 2022, pages 1-10.
Crossref
Purvashi Pasrija, Prakash Jha, Pruthvi Upadhyaya, Mohd. Shoaib Khan & Madhu Chopra. (2022) Machine Learning and Artificial Intelligence: A Paradigm Shift in Big Data-Driven Drug Design and Discovery. Current Topics in Medicinal Chemistry 22:20, pages 1692-1727.
Crossref
Shichao Xu, Lixu Wang, Yixuan Wang & Qi Zhu. (2021) Weak Adaptation Learning: Addressing Cross-domain Data Insufficiency with Weak Annotator. Weak Adaptation Learning: Addressing Cross-domain Data Insufficiency with Weak Annotator.
Yuanhan Li, Jerome P. Keating & Narayanaswamy Balakrishnan. (2021) PMC Theorems on PCR–Ridge Class Estimators. Journal of Statistical Theory and Practice 15:1.
Crossref
Kenan ORÇANLI. (2021) Döküm Sanayinde Süreç Tabanlı Temel Gösterimleri İle İstatistiksel Süreç Kontrolü. Academic Platform Journal of Engineering and Science 9:1, pages 134-158.
Crossref
Ilker KaracaDouglas D. Gransberg & H. David Jeong. (2020) Improving the Accuracy of Early Cost Estimates on Transportation Infrastructure Projects. Journal of Management in Engineering 36:5.
Crossref
John H. Kalivas & Steven D. Brown. 2020. Comprehensive Chemometrics. Comprehensive Chemometrics 213 247 .
Román Salmerón, José García, Catalina García & María del Mar López. (2017) Transformation of variables and the condition number in ridge estimation. Computational Statistics 33:3, pages 1497-1524.
Crossref
L. Motka, B. Stoklasa, M. D’Angelo, P. Facchi, A. Garuccio, Z. Hradil, S. Pascazio, F. V. Pepe, Y. S. Teo, J. Řeháček & L. L. Sánchez-Soto. (2016) Optical resolution from Fisher information. The European Physical Journal Plus 131:5.
Crossref
Parviz Shahbazikhah, John H. Kalivas, Erik Andries & Trevor O'Loughlin. (2016) Using the L 1 norm to select basis set vectors for multivariate calibration and calibration updating . Journal of Chemometrics 30:3, pages 109-120.
Crossref
Richard F. Gunst. 2014. Wiley StatsRef: Statistics Reference Online. Wiley StatsRef: Statistics Reference Online.
Gustavo Cruz-Cárdenas, Lauro López-Mata, José Luis Villaseñor & Enrique Ortiz. (2014) Potential species distribution modeling and the use of principal component analysis as predictor variables. Revista Mexicana de Biodiversidad 85:1, pages 189-199.
Crossref
Cibele C César & Marilia S Carvalho. (2011) Stratified sampling design and loss to follow-up in survival models: evaluation of efficiency and bias. BMC Medical Research Methodology 11:1.
Crossref
Tormod Næs, Per B. Brockhoff & Oliver Tomic. 2010. Statistics for Sensory and Consumer Science. Statistics for Sensory and Consumer Science 67 77 .
Tormod Næs, Per B. Brockhoff & Oliver Tomic. 2010. Statistics for Sensory and Consumer Science. Statistics for Sensory and Consumer Science 227 247 .
J.H. Kalivas. 2009. Comprehensive Chemometrics. Comprehensive Chemometrics 1 32 .
Burkhard Schaffrin. (2007) Minimum mean squared error (MSE) adjustment and the optimal Tykhonov–Phillips regularization parameter via reproducing best invariant quadratic uniformly unbiased estimates (repro-BIQUUE). Journal of Geodesy 82:2, pages 113-121.
Crossref
Shaohua Wu, T. J. Harris & K. B. Mcauley. (2008) The Use of Simplified or Misspecified Models: Linear Case. The Canadian Journal of Chemical Engineering 85:4, pages 386-398.
Crossref
Athanassios Kondylis & Ali S. Hadi. (2006) Derived components regression using the BACON algorithm. Computational Statistics & Data Analysis 51:2, pages 556-569.
Crossref
D. Allan Drummond, Alpan Raval & Claus O. Wilke. (2006) A Single Determinant Dominates the Rate of Yeast Protein Evolution. Molecular Biology and Evolution 23:2, pages 327-337.
Crossref
Richard F. Gunst. 2004. Encyclopedia of Statistical Sciences. Encyclopedia of Statistical Sciences.
Steven Brown. 2004. Encyclopedia of Statistical Sciences. Encyclopedia of Statistical Sciences 1 16 .
S. D. Brown. 2004. Encyclopedia of Statistical Sciences. Encyclopedia of Statistical Sciences.
Richard F. Gunst. 2004. Encyclopedia of Statistical Sciences. Encyclopedia of Statistical Sciences.
S. D. Brown. 2004. Encyclopedia of Statistical Sciences. Encyclopedia of Statistical Sciences.
Juwon Song & Thomas R. Belin. (2004) Imputation for incomplete high‐dimensional multivariate normal data using a common factor model. Statistics in Medicine 23:18, pages 2827-2843.
Crossref
John H. Kalivas, Joel B. Forrester & Heather A. Seipel. (2004) QSAR modeling based on the bias/variance compromise: a harmonious. Journal of Computer-Aided Molecular Design 18:7-9, pages 537-547.
Crossref
Jianqing Cai, Erik W. Grafarend & Burkhard Schaffrin. 2004. V Hotine-Marussi Symposium on Mathematical Geodesy. V Hotine-Marussi Symposium on Mathematical Geodesy 309 324 .
George A. F. Seber & Alan J. Lee. 2003. Linear Regression Analysis. Linear Regression Analysis 531 548 .
John H. Kalivas & Robert L. Green. (2016) Pareto Optimal Multivariate Calibration for Spectroscopic Data. Applied Spectroscopy 55:12, pages 1645-1652.
Crossref
John H. Kalivas. (2001) Basis sets for multivariate regression. Analytica Chimica Acta 428:1, pages 31-40.
Crossref
Beat E Neuenschwander & Bernard D Flury. (2000) Common Principal Components for Dependent Random Vectors. Journal of Multivariate Analysis 75:2, pages 163-183.
Crossref
John H. Kalivas. (1999) Interrelationships of multivariate regression methods using eigenvector basis sets. Journal of Chemometrics 13:2, pages 111-132.
Crossref
Ricardo D. Fierro & James R. Bunch. (1994) Collinearity and Total Least Squares. SIAM Journal on Matrix Analysis and Applications 15:4, pages 1167-1181.
Crossref
Peiliang Xu & Reiner Rummel. (1994) A Simulation Study of Smoothness Methods In Recovery of Regional Gravity Fields. Geophysical Journal International 117:2, pages 472-486.
Crossref
A. Phatak, P.M. Reilly & A. Penlidis. (1993) An approach to interval estimation in partial least squares regression. Analytica Chimica Acta 277:2, pages 495-501.
Crossref
Arvind Rangaswamy & Lakshman Krishnamurthi. (2018) Response Function Estimation Using the Equity Estimator. Journal of Marketing Research 28:1, pages 72-83.
Crossref
Stephen J. Smith. (1990) Use of Statistical Models for the Estimation of Abundance from Groundfish Trawl Survey Data. Canadian Journal of Fisheries and Aquatic Sciences 47:5, pages 894-903.
Crossref
Tormod Næs & Harald Martens. (2005) Principal component regression in NIR analysis: Viewpoints, background details and selection of components. Journal of Chemometrics 2:2, pages 155-167.
Crossref
Sabine Van Huffel & Joos Vandewalle. (1987) Algebraic relationships between classical regression and total least-squares estimation. Linear Algebra and its Applications 93, pages 149-160.
Crossref
John Saunders. (1987) The Specification of Aggregate Market Models. European Journal of Marketing 21:2, pages 5-47.
Crossref
Alan K. Reichert & James S. Moore. (2003) Using Latent Root Regression to Identify Nonpredictive Collinearity in Statistical Appraisal Models. Real Estate Economics 14:1, pages 136-152.
Crossref
Shigeru Yoshioka. (1986) Multicollinearity and Avoidance in Regression Analysis. Behaviormetrika 13:19, pages 103-120.
Crossref
G. Barrie Wetherill, P. Duncombe, M. Kenward, J. Köllerström, S. R. Paul & B. J. VowdenG. Barrie Wetherill, P. Duncombe, M. Kenward, J. Köllerström, S. R. Paul & B. J. Vowden. 1986. Regression Analysis with Applications. Regression Analysis with Applications 82 107 .
M. Precht & P. S. S. N. V. P. Rao. (1985) An evaluation of biased estimators of regression coefficients—A simulation study. Statistische Hefte 26:1, pages 263-285.
Crossref
Per‐Olov Edlund. (2006) Identification of the multi‐input box‐Jenkins transfer function model. Journal of Forecasting 3:3, pages 297-308.
Crossref
W. S. Luk. 1983. Computer Science and Statistics: Proceedings of the 14th Symposium on the Interface. Computer Science and Statistics: Proceedings of the 14th Symposium on the Interface 287 290 .
Robert L. Schaefer. (2006) Bias correction in maximum likelihood logistic regression. Statistics in Medicine 2:1, pages 71-78.
Crossref
Ronald G. Askin. (2006) Multicollinearity in regression: Review and examples. Journal of Forecasting 1:3, pages 281-292.
Crossref
Vivian Faden & Philip Bobko. (2016) Validity Shrinkage in Ridge Regression: A Simulation Study. Educational and Psychological Measurement 42:1, pages 73-85.
Crossref
Gary C. McDonald. 1982. Statistical Decision Theory and Related Topics III. Statistical Decision Theory and Related Topics III 183 191 .
Subhash Sharma & William L. James. (2018) Latent Root Regression: An Alternate Procedure for Estimating Parameters in the Presence of Multicollinearity. Journal of Marketing Research 18:2, pages 154-161.
Crossref
Manfred Nenning, Edgar Topritzhofer & Udo WagnerU. Wagner. 1981. Empirische Marktmodellierung. Empirische Marktmodellierung 137 140 .
James Fennessey & Ronald D'Amico. (2016) Collinearity, Ridge Regression, and Investigator Judgment. Sociological Methods & Research 8:3, pages 309-340.
Crossref
Donald MacLaren. (2008) FORECASTING WHOLESALE PRICES OF MEATS IN THE UNITED KINGDOM BY FIDGE REGRESSION. Journal of Agricultural Economics 31:1, pages 15-27.
Crossref
L. Vanzulli, E. Magnien & L. Olivi. (1980) Caryological stability of Datura innoxia calli analysed by cytophotometry for 22 hormonal combinations. Plant Science Letters 17:2, pages 181-192.
Crossref
John DeeganJr.Jr.. (1979) Constructing statistical models of social processes. Quality and Quantity 13:2, pages 97-119.
Crossref
Donald Maclaren. (2008) Forecasting Wholesale Prices of Meats in the United Kingdom: A Reply. Journal of Agricultural Economics 29:3, pages 335-336.
Crossref
Kenneth M. Warwick. (2018) Computer Abstracts. Journal of Marketing Research 15:3, pages 467-481.
Crossref

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.