1
Box Jenkins (ARIMA) Method using ForecastX Wizard
::2012/04/10::
2
Metodos Predictivos - Universidad Privada de Tacna - ARIMA - Box Jenkins
::2011/08/16::
3
La Méthode de Box-Jenkins avec EVIEWS -1-stationnarisation du série HD
::2013/11/10::
4
box-jenkins
::2013/10/06::
5
ARIMA BOX JENKINS
::2013/12/25::
6
Henry Jenkins - Is the concept of the black box still valid today?
::2010/11/29::
7
Mô hình arima với phương pháp Box -- Jenkins và ứng dụng để dự báo lạm phát của Việt Nam
::2014/01/03::
8
[Doko.VN] Mô hình arima với phương pháp box -- jenkins và ứ...
::2013/10/31::
9
Simon Jenkins @ Outside the Box
::2009/01/13::
10
::2014/02/22::
11
Frank Kern & Andy Jenkins - Biz in a Box - Main Street Marketing Puppets
::2010/04/28::
12
::2014/02/17::
13
12 Gauge Fixes X-Box red ring of death (Killbo Jenkins and tripstar 135 fix red ring)
::2013/03/02::
14
Simon Jenkins @ Outside the Box
::2008/12/10::
15
Jenkins Reunion 2013 - Beat Box
::2014/01/15::
16
In Memory Of Carmen Jenkins (read description box)
::2008/12/24::
17
Alan Moore & Mitch Jenkins - 'Unearthing' Box Set Preview
::2010/06/04::
18
Nick Jenkins - Energy 125 Gear Box Karting
::2014/02/16::
19
Borderlands 2 - Jimmy Jenkins Farming (Opportunity Method)
::2012/09/27::
20
Dave Jenkins - 3d Lacrosse Box Immersion Camp
::2012/08/28::
21
Richie Benaud, Ted Dexter, Christopher Martin Jenkins in the commentary box
::2013/11/12::
22
Musical Snuff Box
::2011/09/10::
23
Alabaster Box- Stacy Jenkins
::2012/05/02::
24
Minecraft with Jenkins - Episode 4 - Wooden Box
::2013/07/16::
25
::2007/12/10::
26
Aaron Hernandez fiancee destroyed evidence in murder case
::2013/10/15::
27
Borderlands 2 How to Spawn Legendary Loot Midgets & Jimmy Jenkins! Farm Pearlescents & Etech Relics!
::2013/04/05::
28
Simon Jenkins @ Outside the Box 19-01-09
::2009/01/22::
29
BOX LIVE #10 HAMED vs JENKINS 1.2.3R (3R TKO) (1993/5)
::2012/12/25::
30
Steven Jenkins motorcycle box
::2013/04/12::
31
Aaron Hernandez Girlfriend Shayanna Jenkins Destroyed Evidence in Murder Case, Prosecutor Alleges
::2014/01/19::
32
The CenterStage FRI., MAY 31st @ The Fuse Box, Hosted by Ryan "Jenks" Jenkins
::2013/05/18::
33
ShowBiz Minute: Jenkins, Miss Universe, Box Offi
::2009/08/24::
34
Mac: Create NFO files, cover, fanart, for Boxee Box, Boxee+
::2012/12/23::
35
Black Ops 2 - Zombies - Buried - Locking The Mystery Box - Teddy Bear -Leroy Jenkins
::2013/07/09::
36
Traxxas Slash 2WD VXL Mike Jenkins Unboxing and Overview 1080HD
::2013/10/31::
37
Another silly lift by chris jenkins 280 off 5 inch box no belt
::2011/10/29::
38
Tumbleweed Tiny House Tour with Ella Jenkins
::2012/10/03::
39
Create New Job in Jenkins
::2011/11/08::
40
Bo Jenkins - Rocky Mountain Way
::2013/07/02::
41
Leroy Jenkins (World of Warcraft Original Video) [SUB]
::2013/02/06::
42
Litter Box Hider
::2012/04/26::
43
Grunge DNA covers Alice In Chains - Man In The Box
::2013/10/08::
44
Benny Hinn Meets Sister Sue Jenkins
::2014/03/24::
45
Wilbert Jenkins - Crawling King Snake
::2013/08/10::
46
JONNYBOY JENKINS PT.1 LIVE AT THE BOX CREWE 27/01/2012 *BASS FACED* A DUBSTEP NIGHT
::2012/02/01::
47
Graze Box Unboxing & Outtakes
::2013/04/14::
48
Allen Jenkins Signature Turkey Calls
::2011/11/15::
49
CrossFit Open 14.3 - Jon Jenkins
::2014/03/16::
50
How to find Jimmy Jenkins - Borderlands 2
::2012/10/11::
NEXT >>
RESULTS [51 .. 101]

In time series analysis, the Box–Jenkins methodology, named after the statisticians George Box and Gwilym Jenkins, applies autoregressive moving average ARMA or ARIMA models to find the best fit of a time series to past values of this time series, in order to make forecasts.

Modeling approach

The original model uses an iterative three-stage modeling approach:

1. Model identification and model selection: making sure that the variables are stationary, identifying seasonality in the dependent series (seasonally differencing it if necessary), and using plots of the autocorrelation and partial autocorrelation functions of the dependent time series to decide which (if any) autoregressive or moving average component should be used in the model.
2. Parameter estimation using computation algorithms to arrive at coefficients that best fit the selected ARIMA model. The most common methods use maximum likelihood estimation or non-linear least-squares estimation.
3. Model checking by testing whether the estimated model conforms to the specifications of a stationary univariate process. In particular, the residuals should be independent of each other and constant in mean and variance over time. (Plotting the mean and variance of residuals over time and performing a Ljung-Box test or plotting autocorrelation and partial autocorrelation of the residuals are helpful to identify misspecification.) If the estimation is inadequate, we have to return to step one and attempt to build a better model.

The data they used were from a gas furnace. These data are well known as the Box and Jenkins gas furnace data for benchmarking predictive models.

Commandeur & Koopman (2007, §10.4) argue that the Box-Jenkins approach is fundamentally problematic. The problem arises because in "the economic and social fields, real series are never stationary however much differencing is done". Thus the investigator has to face the question: how close to stationary is close enough? As the authors note, "This is a hard question to answer". The authors further argue that rather than using Box-Jenkins, it is better to use state space methods, as stationarity of the time series is then not required.

Box-Jenkins model identification

Stationarity and seasonality

The first step in developing a Box–Jenkins model is to determine if the time series is stationary and if there is any significant seasonality that needs to be modelled.

Detecting stationarity

Stationarity can be assessed from a run sequence plot. The run sequence plot should show constant location and scale. It can also be detected from an autocorrelation plot. Specifically, non-stationarity is often indicated by an autocorrelation plot with very slow decay.

Detecting seasonality

Seasonality (or periodicity) can usually be assessed from an autocorrelation plot, a seasonal subseries plot, or a spectral plot.

Differencing to achieve stationarity

Box and Jenkins recommend the differencing approach to achieve stationarity. However, fitting a curve and subtracting the fitted values from the original data can also be used in the context of Box–Jenkins models.

Seasonal differencing

At the model identification stage, the goal is to detect seasonality, if it exists, and to identify the order for the seasonal autoregressive and seasonal moving average terms. For many series, the period is known and a single seasonality term is sufficient. For example, for monthly data one would typically include either a seasonal AR 12 term or a seasonal MA 12 term. For Box–Jenkins models, one does not explicitly remove seasonality before fitting the model. Instead, one includes the order of the seasonal terms in the model specification to the ARIMA estimation software. However, it may be helpful to apply a seasonal difference to the data and regenerate the autocorrelation and partial autocorrelation plots. This may help in the model identification of the non-seasonal component of the model. In some cases, the seasonal differencing may remove most or all of the seasonality effect.

Identify p and q

Once stationarity and seasonality have been addressed, the next step is to identify the order (i.e., the p and q) of the autoregressive and moving average terms. Different authors have different approaches for identifying p and q. Brockwell and Davis (1991, p. 273) state "our prime criterion for model selection [among ARMA(p,q) models] is the AICc", i.e., Akaike information criterion with correction.

Other authors use the autocorrelation plot and the partial autocorrelation plot.

Autocorrelation and partial autocorrelation plots

The sample autocorrelation plot and the sample partial autocorrelation plot are compared to the theoretical behavior of these plots when the order is known.

Specifically, for an AR(1) process, the sample autocorrelation function should have an exponentially decreasing appearance. However, higher-order AR processes are often a mixture of exponentially decreasing and damped sinusoidal components.

For higher-order autoregressive processes, the sample autocorrelation needs to be supplemented with a partial autocorrelation plot. The partial autocorrelation of an AR(p) process becomes zero at lag p + 1 and greater, so we examine the sample partial autocorrelation function to see if there is evidence of a departure from zero. This is usually determined by placing a 95% confidence interval on the sample partial autocorrelation plot (most software programs that generate sample autocorrelation plots also plot this confidence interval). If the software program does not generate the confidence band, it is approximately $\pm 2/\sqrt{N}$, with N denoting the sample size.

The autocorrelation function of a MA(q) process becomes zero at lag q + 1 and greater, so we examine the sample autocorrelation function to see where it essentially becomes zero. We do this by placing the 95% confidence interval for the sample autocorrelation function on the sample autocorrelation plot. Most software that can generate the autocorrelation plot can also generate this confidence interval.

The sample partial autocorrelation function is generally not helpful for identifying the order of the moving average process.

The following table summarizes how one can use the sample autocorrelation function for model identification.

Shape Indicated Model
Exponential, decaying to zero Autoregressive model. Use the partial autocorrelation plot to identify the order of the autoregressive model.
Alternating positive and negative, decaying to zero Autoregressive model. Use the partial autocorrelation plot to help identify the order.
One or more spikes, rest are essentially zero Moving average model, order identified by where plot becomes zero.
Decay, starting after a few lags Mixed autoregressive and moving average (ARMA) model.
All zero or close to zero Data are essentially random.
High values at fixed intervals Include seasonal autoregressive term.
No decay to zero Series is not stationary.

In practice, the sample autocorrelation and partial autocorrelation functions are random variables and do not give the same picture as the theoretical functions. This makes the model identification more difficult. In particular, mixed models can be particularly difficult to identify. Although experience is helpful, developing good models using these sample plots can involve much trial and error.

Box–Jenkins model estimation

Estimating the parameters for the Box–Jenkins models is a quite complicated non-linear estimation problem. For this reason, the parameter estimation should be left to a high quality software program that fits Box–Jenkins models. Fortunately, many statistical software programs now fit Box–Jenkins models.

The main approaches to fitting Box–Jenkins models are non-linear least squares and maximum likelihood estimation. Maximum likelihood estimation is generally the preferred technique. The likelihood equations for the full Box–Jenkins model are complicated and are not included here. See (Brockwell and Davis, 1991) for the mathematical details.

Box–Jenkins model diagnostics

Assumptions for a stable univariate process

Model diagnostics for Box–Jenkins models is similar to model validation for non-linear least squares fitting.

That is, the error term At is assumed to follow the assumptions for a stationary univariate process. The residuals should be white noise (or independent when their distributions are normal) drawings from a fixed distribution with a constant mean and variance. If the Box–Jenkins model is a good model for the data, the residuals should satisfy these assumptions.

If these assumptions are not satisfied, one needs to fit a more appropriate model. That is, go back to the model identification step and try to develop a better model. Hopefully the analysis of the residuals can provide some clues as to a more appropriate model.

One way to assess if the residuals from the Box–Jenkins model follow the assumptions is to generate statistical graphics (including an autocorrelation plot) of the residuals. One could also look at the value of the Box–Ljung statistic.

References

• Box, George and Jenkins, Gwilym (1970) Time series analysis: Forecasting and control, San Francisco: Holden-Day.
• Brockwell, Peter J. and Davis, Richard A. (1991). Time Series: Theory and Methods. Springer-Verlag.
• Commandeur J.J.F., Koopman S.J. (2007), Introduction to State Space Time Series Analysis (Oxford University Press).
• Pankratz, Alan (1983) Forecasting with univariate Box–Jenkins models: concepts and cases, New York: John Wiley & Sons.