A Simulation Study of Some Restricted Estimators in Restricted Linear Regression Model
Main Article Content
Abstract
When the multicollinearity exists in linear regression model, the result of the Restricted Least Square estimator (RLS) is unstable. So that, more researchers proposed the restricted biased estimators to improve the efficiency of RLS estimator. In this paper, Some of biased restricted estimators have been introduced to study the performance of them. The simulation study has been given to compare these estimators. According to simulation study, we found that, the shrinkage restricted ridge regression (SRRE) estimator which proposed by Baber and Mustafa [1], has good properties comparing with other restricted estimators that given in this study. A Numerical example has been considered to illustrate the performance of these estimators
Article Details

This work is licensed under a Creative Commons Attribution 4.0 International License.
Tikrit Journal of Pure Science is licensed under the Creative Commons Attribution 4.0 International License, which allows users to copy, create extracts, abstracts, and new works from the article, alter and revise the article, and make commercial use of the article (including reuse and/or resale of the article by commercial entities), provided the user gives appropriate credit (with a link to the formal publication through the relevant DOI), provides a link to the license, indicates if changes were made, and the licensor is not represented as endorsing the use made of the work. The authors hold the copyright for their published work on the Tikrit J. Pure Sci. website, while Tikrit J. Pure Sci. is responsible for appreciate citation of their work, which is released under CC-BY-4.0, enabling the unrestricted use, distribution, and reproduction of an article in any medium, provided that the original work is properly cited.
References
[1] Bader. A. M and Mustafa I. N (2021). New Shrinkage Restricted Estimator For Restricted Linear Regression Model .AIP Conference Proceedings (Under Publication).
[2] S. Kaçıranlar, S. Sakallıo˘glu, F. Akdeniz, G.P.H. Styan, and H.J. Werner (1999), A new biased estimator in linear regression and a detailed analysis of the widely analyzed dataset on Portland Cement. Sankhya: Indian J. Stat. B 61(3), pp. 443–459
[3] Hua Huang, Jibo & Wende (2016). On the restricted almost unbiased two parameter estimator in linear regression model, Communications in Statistics- Theory and Methods
[4] Özkale, M. R., and S. Kaciranlar, (2007): The restricted and unrestricted two-parameter estimators. Communications in Statistics—Theory and Methods, 36, 2707-2725.
[5] Hoerl, A. E. & Kennard, R. W. (1970). Ridge regression: Biased estimation for non- orthogonal problems. Technometrics, 12(1), 55-67.
[6] Hoerl, A. E., Kennard, R. W., & Baldwin, K. F. (1975). Ridge regression: Some simulations. Communications in Statistics, 4(2), 105-123.
[7] Lawless, J. F. & Wang, P. (1976). A simulation study of ridge and other regression estimators. Communications in Statistics – Theory and Methods, 5(4), 307-323
[8] Hocking, R. R., Speed, F. M., & Lynn, M. J. (1976). A class of biased estimators in linear regression. Technometrics, 18(4), 55-67.
[9] Nomura, M. (1988). On the almost unbiased ridge regression estimation. Communication in Statistics – Simulation and Computation, 17(3), 729-743.
[10] Kibria, B. M., & Banik, S. (2016). Some ridge regression estimators and their performances. Journal of Modern Applied Statistical Methods, 15(1), 12.
[11] Khalaf, G. & Shukur, G. (2005). Choosing ridge parameters for regression problems. Communications in Statistics – Theory and Methods, 34(5), 1177-1182.
[12] Alkhamisi, M., Khalaf, G., & Shukur, G. (2006). Some modifications for choosing ridge parameters. Communications in Statistics – Theory and Methods, 35(11), 2005-2020.
[13] Kibria, B. M. G. (2003). Performance of some new ridge regression estimators. Communications in Statistics – Simulation and Computation, 32(2), 419-435 [14] M.N Lattef, M .I ALheety (2020). Study of Some Kinds of Ridge Regression Estimators in Linear Regression Model. Tikrit Journal of Pure Since,[5.1] v.25,n.1 ,pp. 130-142.
[15] Najarian, S., Arashi, M. and Kibria, B. M. G. (2013). A Simulation Study on Some Restricted Ridge Regression Estimators. Comm. Statist. Sim. Comp., 42, 871-879
[16] Akdeniz, F., Erol, H. (2003). Mean squared error matrix comparisons of some biased estimators in linear regression. Communications in Statistics Theory and Methods, 32:2389–2413
[17] Gruber, M. (2017). Improving Efficiency by Shrinkage: The James--Stein and Ridge Regression Estimators. Routledge.