Bayesian Estimation of Normal Linear Regression Model with Heteroscedasticity Error Structures

Main Article Content

Bolanle A. Oseni
Olusanya E. Olubusoye
Adedayo A. Adepoju

Abstract

Non-constant error variance in Normal Linear Regression Model (NLRM) is an econometric problem generally referred to as heteroscedasticity. Its presence renders statistical inference invalid. Classical approach to its detection, estimation and remediation are widely discussed in the econometric literature. However, estimation of a NLRM using the Bayesian approach when heteroscedasticity problem is present is a major gap in the existing stock of knowledge on this subject. This approach has grown widely in recent times because it combines out-of-sample information with observed data. The study derived Bayesian estimators of the NLRM in the presence of functional forms of heteroscedasticity. Variance was treated as a linear function and as an exponential function of exogenous variables. The estimators are found to be unbiased and consistent and the precision values tend to zero. The estimates obtained from the estimators approximately 95% draws fall within each of the corresponding credible interval. Therefore, the results obtained for the derived Bayesian estimators for different functional forms of heteroscedasticity considered are similar, thus, providing a credible alternative to the existing classical methods which depend solely on the sample information.

Keywords:
Asymptotic behaviour, estimator, linear function, exponential function, exogenous variables.

Article Details

How to Cite
Oseni, B., Olubusoye, O., & Adepoju, A. (2019). Bayesian Estimation of Normal Linear Regression Model with Heteroscedasticity Error Structures. Asian Journal of Probability and Statistics, 4(2), 1-13. https://doi.org/10.9734/ajpas/2019/v4i230111
Section
Original Research Article

References

White H. A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica. 1980;48:817-838.

Gujarati DN. Basic econometrics, 4th Ed. New York: McGraw-Hill; 2003.

Cribari-Neto F. Asymptotic inference under heteroscedasticty of un-known form. Computational Statistics and Data Analysis. 2004;45:215-233.

Geary RC. A note on residual heterovariance and estimation efficiency in regression. American Statistician. 1966;20:30-31.

Pasha GR. Estimation methods for regression models with unequal error variances. Ph.D Thesis, University of Warwick; 1982.

Hadri K, Guermat C. Heteroscedasticity in stochasic frontier models. A Monte Carlo analysis. 1999;1-8.

Mackinnon JG, White H. Some heteroscedasticty consistent covariance matrix estimators with improved finite sample properties. Journal of Econometrics. 1985;29:53-57.

Davidson R, Makinnon JG. Estimation and inference in econometrics. Oxford University Press; Econometric Theory. 1993;3:631-635.

Hansen BE. Consistent covariance matrix estimation for dependent heterogeneous processes. Econometrica. 1982;60(4):967-972.

White H, Domowitz I. Nonlinear regression with dependent observations. Econometrica. 1984;52:143-161.

Newey WD, West KD. A simple positive semi-de_nite,heteroscedasticity and autocorrelation consistent covariance matrix. Econometrica. 1987;55:703-708.

Muller UK. Risk of Bayesian inference in misspecified model and the Sandwich covariance matrix. Working Paper, Princeton University; 2009.

Poirier DJ. Bayesian interpretations of heteroscedastic consistent covariance estimatiors using the informed Bayesian bootstrap. Econometric Reviews. 2011;30:457-468.

Norets A. Bayesian regression with nonparametric heteroskedasticity. Working Paper, Princeton University. 2012;14.

Startz R. Bayesian heteroscedasticity robust standard errors. Department Economics, University of California, Santa Barbara; 2013.

Koop G. Bayesian econometrics. UK: John Wiley & Sons Ltd.; 2003.

Harvey AC. Estimating regression model with multiplicative heteroscedasticity. Ecomonetrica. 1976;44:461-465.

Gelman A. Prior distributions for variance parameters in hierarchical models. Bayesian Analysis. 2006;1(3):515-533.

Raifa H, Schlaifer R. Applied statistical decision theory. Division of Research, Graduate School of Business Administration, Harvard University; 1961.