Selection of Linear Time Series Model on the Basis of Out-of-Sample Prediction Criteria

Main Article Content

Akpensuen Shiaondo Henry
Kazeem Eyitayo Lasisi
Emmanuel Alphonsus Akpan
Edeghagba Eghosa Elijah


Background: In linear time series, the in-sample model selection and the out-of-sample model selection are the two common approaches to model selection. However, empirical evidence based on out-of-sample forecast performance is generally considered more trustworthy than evidence based on in-sample performance, which is deficient in providing information about future observations.

Aim: The aim of the study is to select the best linear time series model suitable to predict Nigeria exchange rates for the period 2002-2018.

Materials and Methods: Data on naira to pound and naira to euro exchange rates from January 2002 to December 2018, comprising of 204 data points were considered. The data were divided into two portions; the first portion which comprises of 192 observations was used for model building while the second portion with 12 observations was used for out-of-sample prediction evaluation. The Box-Jenkins ARIMA iterative procedure was used in model building while the mean square error (MSE), root mean square error (RMSE), mean absolute error (MAE) and Theil’s U coefficient were the measures of accuracy adopted in selecting the best out-of sample model.

Results: Our results revealed that, based on in-sample model selection, ARIMA (0, 1, 1) and ARIMA (1, 1, 0) were the appropriate models with minimum information criteria. However, on the basis of out-sample forecast performance evaluation criteria, ARIMA (1, 1, 0) and ARIMA (1, 1, 2) were found to be appropriate out-of-sample models with minimum forecast evaluation criteria. In all, our results showed that, the out-of sample models performed better than their in-sample counterparts in their ability to forecast future values.

Conclusion: So far, this study revealed that out-of-sample is a better model selection criterion than the in-sample counterpart as evident in its ability to predict future values which is the very essence for modelling in time series.

In-sample, out-of-sample, model selection, ARIMA model, time series.

Article Details

How to Cite
Henry, A. S., Lasisi, K. E., Akpan, E. A., & Elijah, E. E. (2019). Selection of Linear Time Series Model on the Basis of Out-of-Sample Prediction Criteria. Asian Journal of Probability and Statistics, 4(3), 1-13.
Original Research Article


Burnham KP, Anderson DR. Model selection and multimodel inference a practical information-theoretic approach. Second Edition. (Springer-Verlag New York, Inc, 175 Fifth Avenue, New York, NY 10010, USA); 2002.

Ongbali SO, et al. Model selection process in time series analysis of production system with random output. IOP Conf. Series: Materials Science and Engineering. 2018;413:012057.
DOI: 10.1088/1757-899X/413/1/012057

Igboanugo AC, Ongbali SO. A factorial study of bottleneck problems in multi-stage production system: Results from textile industry. University of Benin Journal of Science & Technology. 2012;1.

Shibata R. Statistical aspects of model selection. Working Paper [C]. International Institute for Applied Systems Analysis. Laxenburg, Austria. 1989;A-2361.

Hastie T, Tibshirani R, Friedman J. The elements of statistical learning: Data mining. Inference and prediction. Springer Series in Statistics. Springer-Verlag, New York, NY, 2nd Edition.

Akaike HA. New look at the statistical model identification. IEEE Transactions on Automatic Control. 1973;19(6):716-723.

Schwarz G. Estimating the dimension of a model. Annals of Statistics. 1978;6(2):461-464.

Hannan E, Quinn B. The determination of the order of an autoregression. Journal of Royal Statistical Society, Series B. 1979;41:190-195.

Moffat IU, Akpan EA. Time series forecasting: A tool for out-sample model and evaluation. American Journal of Scientific and Industrial Research. 2014;5(6):185- 194.
DOI: 10.5251/ajsir.2014.

Chatfield C. Time series forecasting (5th Ed.). New York: Chapman and Hall CRC, Boca Raton-London-New York-Washington; 2000.

Ette HE. Forecasting Nigeria Naira – US dollar exchange rate by a seasonal ARIMA model. America Journal of Scientific Research. 2012;59:71-78.

Muhammed MB, Abdulmuahymin SA. Modelling the exchange ability of Nigerian currency (Naira) with respect to US Dollar. International Journal of Scientific and Engineering research. 2016;7(7):86-104.

Nwankwo SC. Autoregressive Integrated Moving Average (ARIMA) model for exchange rate (Naira to dollar) Academic Journal of Interdisciplinary Studies. 2014;3(4):182- 195.
DOI: 10.5901/ajis.2014.v3n4p429

Oladejo MO, Abdullahi. A suitable model for the forecast of exchange rate in Nigeria (Naira versus US Dollar). International Journal of Science and Research. 2015;4(5):2669-2676.

Osbuohien IO, Edokpa IW. Forecasting exchange rate between the Nigeria Naira and the US Dollar using ARIMA model. International Journal of Engineering Science I Invention. 2013;2(4):16-22.

Hipel KW, McLeod AI. Time series modelling of water resources and environmental systems. Amsterdam, Elsevier; 1994.

Dickey D, Fuller WA. Distribution of the estimators for autoregressive time series with a unit root. Journal of the American Statistical Association. 1979;74:427-431.

Ellliot G, Rothenberg TJ, Stock JH. Efficient tests for an autoregressive unit root. Econometrica. 1996;64(4):813-836.

Phillips PCB, Perron P. Testing for unit roots in time series regression. Biometrika. 1988;75:335-346.

Fisher RA. Statistical methods and scientific inference. Oliver & Boyd, Edinburgh; 1956.

Box GEP, Tiao GC. Intervention analysis with applications to economic and environmental problems. Journal of American Statistical Association. 1975;7:70-79.

Tsay RS. Analysis of financial time series. 3rd Ed. New York: John Wiley & Sons Inc. 2010;97-140.

Akpan EA, Lasisi KE, Adamu A. Identification of heteroscedasticity in the presence of outliers in discrete-time series. Asian Research Journal of Mathematics. 2018;10(1):1-20.

Henry de-Graft Acquah. Comparison of Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC) in selection of an asymmetric price relationship. Journal of Development and Agricultural Economics. 2010;2(1):001-006.

Hamzacebi C. Improving artificial neural networks’ performance in seasonal time series forecasting. Information Sciences. 2008;178:4550-4559.