Assessment of the Effects of Influential Observations on Heteroscedasticity Detection in Multiple Linear Regression
DOI:
https://doi.org/10.70882/josrar.2026.v3i6.99Keywords:
Outlying observations, Influential Observations, Heteroscedasticity, Linear RegressionAbstract
Influential observations can substantially affect regression diagnostics and lead to misleading conclusions about the presence of heteroscedasticity. This study investigated the effects of bad leverage points (BLPs) and vertical outliers (VOs) on heteroscedasticity detection in multiple linear regression using the classical White test (WT) and robust White test (RWT). Four numerical examples and Monte Carlo simulation experiments involving 2,000 replications were employed to evaluate the behaviour of both tests under different contamination conditions. The simulation experiments considered sample sizes ranging from 20 to 250 and contamination levels of 5% and 10%. Results indicated that introducing BLPs into initially homoscedastic datasets increased the tendency of the classical White test to reject the homoscedasticity hypothesis, while the robust White test generally retained the expected decision. Conversely, introducing VOs into heteroscedastic datasets reduced the ability of the classical White test to detect heteroscedasticity, whereas the robust test continued to reject the null hypothesis. These findings suggest that influential observations can either enhance or mask evidence of heteroscedasticity in conventional regression diagnostics. The study highlights the importance of robust diagnostic procedures when analysing contaminated regression datasets and recommends further evaluation of their empirical rejection rates and statistical properties under alternative contamination mechanisms.
References
Alguraibawi, M., Midi, H., and Imon, A. H. M. (2015). A new robust diagnostic plot for classifying good and bad high leverage points in a multiple linear regression model.Mathematical Problems in Engineering, 1:1-12
Alih, E., and Choon, H. O. (2015). An outlier-resistant test for heteroscedasticity in linear models. Journal of Applied Statistics, 42(8):1617-1634.
Bagheri, A. and Habshah M. (2015). "Diagnostic plot for the identification of high leverage collinearity-influential observations." SORT 39(1): 51-70.
Habshah M., Norazan MR and Rahmatullah Imon AHM (2009). The performance of diagnostic-robust generalized potentials for the identification of multiple high leverage points in linear regression.Journal of applied statistics 36(5): 507-520.
Habshah Midi, Muhammad Sani Shelan Saied Ismaeel (2021) Fast Improvised Influential Distance for the Identification of Influential Observations in Multiple Linear Regression. Sains Malaysiana, 50 (7) (2021): 2085-2094 http://doi.org/10.17576/jsm-2021-5007-22
Hossain, M. G., Zyroul, R., Pereira, B. P., and Kamarul, T. (2012). Multiple regression analysis of factors influencing dominant hand grip strength in an adult Malaysian population. Journal of Hand Surgery (European Volume), 37(1), 65-70.
Imon A.H.M.R. and Khan M.A.I. (2003) A solution to the problem of multicollinearity caused by the presence of multiple high leverage points, Int. J. Stat. Sci. 2:37–50
Lima, V.M.C., Souza, T, C., Cribari-Neto, F. and Fernandes, G.B. (2009). Heteroskedasticity- robust inference in linear regressions. Communications in Statistics-Simulation and Computation 39: 194-206
Pindyck, S.R and Rubinfeld, L.D. (1997). Econometric Models and EconometricForecasts, 4th Edition. New York: Irwin/McGraw-Hill.
Rana M.S., H. Midi, and A.H.M.R. Imon, (2008). A Robust Modification of the Goldfeld-Quandt Test for the Detection of Heteroscedasticity in the Presence of Outliers, Journal of mathematics and Statistics, 4(4), 2008, pp. 277-283
Sani, M., Habshah M. and Babangida I.B. (2019) Robust White’s Test For Heteroscedasticity Detection In Linear Regression FUDMA journal of science, 3(2): 173- 178
Sani M. (2018) Robust diagnostic and parameter estimation for multiple linear and panel data regression models. Unpublished Ph.D. dissertation, Institute for Mathematical Research, Universiti Putra Malaysia
Sani, M., Midi, H. & Arasan, J. (2019) The Performance of Robust Heteroscedasticity Consistent Covariance Matrix Estimator. Malaysian Journal of Mathematical Sciences, 13(S): 71–88 (2019)
White, H. (1980). A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 48: 817-838
Yohai, V. J. (1987). "High breakdown-point and high efficiency robust estimates for regression." The Annals of Statistics: 642-656.
Downloads
Published
Issue
Section
Categories
License
Copyright (c) 2026 Muhammad Sani, Aliyu Usman Goga, Mustapha Isyaku (Author)

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- NonCommercial — You may not use the material for commercial purposes.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.