Bayesian estimation of ridge parameter under different loss functions

Abstract

In linear regression modeling, the presence of multicollinearity among the explanatory variables has undesirable effects on the maximum likelihood estimator (MLE). To overcome this effect, we proposed some new ridge parameters under Bayesian paradigm. Moreover, we also compare these ridge parameters with Bayesian approach under different loss functions. To access the performance of new ridge parameters, we conduct a Monte Carlo simulation study where mean squared error (MSE) is considered as an evaluation criterion. In addition, a real life example is also provided to assess the superiority of the proposed estimators on the basis of MSE and cross-validation approaches. The simulation and real application results show that the Bayesian ridge parameter estimated under Precautionary loss function is better as compared to the other loss functions as well as the MLE and ordinary ridge regression estimator.

Keywords:

• BRREs
• loss functions
• maximum likelihood estimator
• mean squared error
• posterior distribution
• ridge parameters