Study of Some Kinds of Ridge Regression Estimators in Linear Regression Model
Article Sidebar
Main Article Content
Abstract
In linear regression model, the biased estimation is one of the most commonly used methods to reduce the effect of the multicollinearity. In this paper, a simulation study is performed to compare the relative efficiency of some kinds of biased estimators as well as for twelve proposed estimated ridge parameter (k) which are given in the literature. We propose some new adjustments to estimate the ridge parameter. Finally, we consider a real data set in economics to illustrate the results based on the estimated mean squared error (MSE) criterion.
According to the results, all the proposed estimators of (k) are superior to ordinary least squared estimator (OLS), and the superiority among them based on minimum MSE matrix will change according to the sample under consideration.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Tikrit Journal of Pure Science is licensed under the Creative Commons Attribution 4.0 International License, which allows users to copy, create extracts, abstracts, and new works from the article, alter and revise the article, and make commercial use of the article (including reuse and/or resale of the article by commercial entities), provided the user gives appropriate credit (with a link to the formal publication through the relevant DOI), provides a link to the license, indicates if changes were made, and the licensor is not represented as endorsing the use made of the work. The authors hold the copyright for their published work on the Tikrit J. Pure Sci. website, while Tikrit J. Pure Sci. is responsible for appreciate citation of their work, which is released under CC-BY-4.0, enabling the unrestricted use, distribution, and reproduction of an article in any medium, provided that the original work is properly cited.
References
[1] Lukman, A. F., Ayinde, K., Binuomote, S., & Clement, O. A. (2019). Modified ridge‐type estimator to combat multicollinearity: Application to chemical data. Journal of Chemometrics, 33(5), e3125.
[2] Hoerl, A. E. & Kennard, R. W. (1970). Ridge regression: Biased estimation for non- orthogonal problems. Technometrics, 12(1), 55-67.
[3] Kibria, B. M., & Banik, S. (2016). Some ridge regression estimators and their performances. Journal of Modern Applied Statistical Methods, 15(1), 12.
[4] Crouse, R., Jin, C., & Hanumara, R. (1995). Unbiased ridge estimation with prior informatics and ridge trace. Communications in Statistics – Theory and Materials, 24(9), 2341-2354.
[5] Batah, F. S. M., & Gore, S. D. (2009). Ridge regression estimator: Combining unbiased and ordinary ridge regression methods of estimation. Surveys in Mathematics and its Applications, 4, 99-109.
[6] Lukman, A. F., Ayinde, K., Siok Kun, S., & Adewuyi, E. T. (2019). A modified new two-parameter estimator in a linear regression model. Modelling and Simulation in Engineering, 2019.
[7] Tarima, S., Tuyishimire, B., Sparapani, R., Rein, L., & Meurer, J. (2020). Estimation Combining Unbiased and Possibly Biased Estimators. Journal of Statistical Theory and Practice, 14(2), 18.
[8] Özkale, M. R., & Kaciranlar, S. (2007). The restricted and unrestricted two-parameter estimators. Communications in Statistics—Theory and Methods, 36(15), 2707-2725.
[9] Asar, Y., & Genç, A. (2017). Two-parameter ridge estimator in the binary logistic regression. Communications in Statistics - Simulation and Computation, 46(9), 7088-7099.
[10] Hoerl, A. E., Kennard, R. W., & Baldwin, K. F. (1975). Ridge regression: Some simulations. Communications in Statistics, 4(2), 105-123.
[11] Lawless, J. F. & Wang, P. (1976). A simulation study of ridge and other regression estimators. Communications in Statistics – Theory and Methods, 5(4), 307-323.
[12] Hocking, R. R., Speed, F. M., & Lynn, M. J. (1976). A class of biased estimators in linear regression. Technometrics, 18(4), 55-67.
[13] Nomura, M. (1988). On the almost unbiased ridge regression estimation. Communication in Statistics – Simulation and Computation, 17(3), 729-743.
[14] Kibria, B. M. G. (2003). Performance of some new ridge regression estimators. Communications in Statistics – Simulation and Computation, 32(2), 419-435.
[15] Khalaf, G. & Shukur, G. (2005). Choosing ridge parameters for regression problems. Communications in Statistics – Theory and Methods, 34(5), 1177-1182.
[16] Alkhamisi, M., Khalaf, G., & Shukur, G. (2006). Some modifications for choosing ridge parameters. Communications in Statistics – Theory and Methods,35(11), 2005-2020.
[17] Lukman, A. F., Ayinde, K., & Ajiboye, A. S. (2017). Monte Carlo study of some classification-based ridge parameter estimators. Journal of Modern Applied Statistical Methods, 16(1), 24.
[18] Gruber, M. (2017). Improving Efficiency by Shrinkage: The James--Stein and Ridge Regression Estimators. Routledge.
[19] Akdeniz, F. & Erol, H. (2003). Mean squared error matrix comparisons of some biased estimators in linear regression. Communications in Statistics – Theory and Methods, 32(12), 2389-2413