Robust Weighted Least Squares Estimation of Regression Parameter in the Presence of Outliers and Heteroscedastic Errors

Abstract

In a linear regression model, the ordinary least squares (OLS) method is considered the best method to estimate the regression parameters if the assumptions are met. However, if the data does not satisfy the underlying assumptions, the results will be misleading. The violation for the assumption of constant variance in the least squares regression is caused by the presence of outliers and heteroscedasticity in the data. This assumption of constant variance (homoscedasticity) is very important in linear regression in which the least squares estimators enjoy the property of minimum variance. Therefor e robust regression method is required to handle the problem of outlier in the data. However, this research will use the weighted least square techniques to estimate the parameter of regression coefficients when the assumption of error variance is violated in the data. Estimation of WLS is the same as carrying out the OLS in a transformed variables procedure. The WLS can easily be affected by outliers. To remedy this, We have suggested a strong technique for the estimation of regression parameters in the existence of heteroscedasticity and outliers. Here we apply the robust regression of M-estimation using iterative reweighted least squares (IRWLS) of Huber and Tukey Bisquare function and resistance regression estimator of least trimmed squares to estimating the model parameters of state-wide crime of united states in 1993. The outcomes from the study indicate the estimators obtained from the M-estimation techniques and the least trimmed method are more effective compared with those obtained from the OLS.

The Effect of Smoking Behavior on Health Expenditure in Indonesia’s Rural Areas

“…However, MLR has a weakness, namely the problem of classical assumptions. Therefore, robust regression is used to create the best model and avoid the problem of classical assumptions (Pesko and Robarts, 2017;Rasheed et al, 2014) . 4 showed that consumption of one cigarette in rural areas had a positive and significant effect.…”

Determinan Pengeluaran Rokok Elektrik di Kota Bandung

“…Penelitian ini telah menggunakan robust pada model regresi linear berganda yang digunakan. Analisis regresi robust menjadi solusi untuk regresi linear agar terhindar dari masalah asumsi klasik (Rasheed et al 2014). Dengan penggunaan regresi robust akan menciptakan model terbaik dan stabil (Thoni et al 1990).…”

Karakteristik Ekonomi Pada Pengguna Ganda Rokok Elektrik dan Rokok Konvensional Pada Mahasiswa di Kota Bandung

“…Penggunaan regresi logistik sangat mirip degan regresi linar berganda dengan pengecualian bahwa variabel terikat pada regresi logistik adalah binomial. Hasil regresi l o g i s t i k a k a n m e n u n j u k k a n r a s i o kemungkinan yang disebabkan dari masingmasing variabel bebas yang diamati (Sperandei, 2014 Penggunaan robust dilakukan pada penelitian ini agar model regresi terhindar dari masalah asumsi klasik (Rasheed, Adnan, Saffari, & Pati, 2014). Hasil yang terbaik akan diperoleh dari penggunaan regresi robust (Thoni, Neter, Wasserman, & Kutner, 1990 Hasil regresi logistik menunjukkan bahwa terdapat 4 variabel yang memperbesar k e m u n g k i n a n s e o r a n g m a h a s i s w a mengkonsumsi rokok elektrik dan rokok konvensional secara bersamaan dan terdapat 2 variabel yang memperkecil kemungkinan seorang mahasiswa mengkonsumsi rokok elektrik dan rokok konvensional secara bersamaan.…”