A Comparative Approach on Bridge and Elastic Net Regressions

Abstract:

Machine Learning techniques such as Regression have been developed to investigate associations between risk factor and disease in multivariable analysis. However, multicollinearity amongst explanatory variables becomes a problem which makes interpretation more difficult and degrade the predictability of the model. This study compared Bridge and Elastic Net regressions in handling multicollinearity in multivariable analysis. Wisconsin Diagnostic Breast Cancer data was used for comparison for model fit and in handling multicollinearity between the regression techniques. Comparison were made using MSE, RMSE, R^2, VIF, AIC and BIC for efficiency. Scatter plots was employed to show fitted regression models. The results from the study show that, the Bridge regression performed better in solving the problem of multicollinearity with VIF value of 1.182296 when 𝛾 = 2 compared to Elastic Net regression with a VIF value of 1.204298 respectively. In comparison for best model fit, Bridge regression with 𝛾 = 0.5 performed better with MSE of 11.58667, AIC value of 258.9855 and BIC of 277.2217 respectively. Consequently, we can conclude that both the Bridge and Elastic Net Regressions can be used in handling multicollinearity problems that exist in multivariable regression analysis. Information on machine learning such as this, can help those in the medical fields to improve diagnosis, narrow clinical trials and biopsy to proffer effective treatment.