A new class of efficient and debiased two-step shrinkage estimators: method and application

• Published in: Journal of applied statistics Vol. 49; no. 16; pp. 4181 - 4205
• Main Authors: Qasim, Muhammad, Månsson, Kristofer, Sjölander, Pär, Kibria, B. M. Golam
• Format: Journal Article
• Language: English
• Published: Abingdon Taylor & Francis 10-12-2022; Taylor & Francis Ltd
• Subjects: Algorithms; chemical structures; Debiased estimator; Empirical analysis; Errors; Estimators; Mean square errors; Mean square values; Monte Carlo simulation; Monte Carlo simulations; multicollinearity; Parameter estimation; Regression models; ridge regression; Statistical methods; two-parameter estimator
• ISSN: 0266-4763; 1360-0532; 1360-0532
• DOI: 10.1080/02664763.2021.1973389

This paper introduces a new class of efficient and debiased two-step shrinkage estimators for a linear regression model in the presence of multicollinearity. We derive the proposed estimators' mean square error and define the necessary and sufficient conditions for superiority over the existing estimators. In addition, we develop an algorithm for selecting the shrinkage parameters for the proposed estimators. The comparison of the new estimators versus the traditional ordinary least squares, ridge regression, Liu, and the two-parameter estimators is done by a matrix mean square error criterion. The Monte Carlo simulation results show the superiority of the proposed estimators under certain conditions. In the presence of high but imperfect multicollinearity, the two-step shrinkage estimators' performance is relatively better. Finally, two real-world chemical data are analyzed to demonstrate the advantages and the empirical relevance of our newly proposed estimators. It is shown that the standard errors and the estimated mean square error decrease substantially for the proposed estimator. Hence, the precision of the estimated parameters is increased, which of course is one of the main objectives of the practitioners.