## Calibrated probabilistic forecasting at the Stateline wind energy center: The regime-switching space-time (RST) method (2004)

### Cached

### Download Links

Venue: | Journal of the American Statistical Association |

Citations: | 19 - 10 self |

### BibTeX

@TECHREPORT{Gneiting04calibratedprobabilistic,

author = {Tilmann Gneiting and Kristin Larson and Kenneth Westrick and Marc G. Genton and Eric Aldrich},

title = {Calibrated probabilistic forecasting at the Stateline wind energy center: The regime-switching space-time (RST) method},

institution = {Journal of the American Statistical Association},

year = {2004}

}

### Years of Citing Articles

### OpenURL

### Abstract

With the global proliferation of wind power, accurate short-term forecasts of wind resources at wind energy sites are becoming paramount. Regime-switching space-time (RST) models merge meteorological and statistical expertise to obtain accurate and calibrated, fully probabilistic forecasts of wind speed and wind power. The model formulation is parsimonious, yet takes account of all the salient features of wind speed: alternating atmospheric regimes, temporal and spatial correlation, diurnal and seasonal non-stationarity, conditional heteroscedasticity, and non-Gaussianity. The RST method identifies forecast regimes at the wind energy site and fits a conditional predictive model for each regime. Geographically dispersed meteorological observations in the vicinity of the wind farm are used as off-site predictors. The RST technique was applied to 2-hour ahead forecasts of hourly average wind speed at the Stateline wind farm in the US Pacific Northwest. In July 2003, for instance, the RST forecasts had root-mean-square error (RMSE) 28.6 % less than the persistence forecasts. For each month in the test period, the RST forecasts had lower RMSE than forecasts using state-of-the-art vector time series techniques. The RST method provides probabilistic forecasts in the form of

### Citations

1620 | Time Series Analysis Forecasting and Control - Box, Jenkins - 1976 |

462 |
Generalized autoregressive conditional heteroscedasticity
- Bollerslev
- 1986
(Show Context)
Citation Context ...l of order at most 4. The conditionally heteroscedastic AR-N-CH technique, furthermore, uses the S+FinMetrics function garch to fit a GARCH(1,1) model for the conditional variance of the innovations (=-=Bollerslev 1986-=-; Zivot and Wang 2003, Chapter 7). The AR-D and AR-D-CH methods estimate and extract a diurnal trend component of the form (13) and then proceeds as above. To obtain Gaussian predictive distribution f... |

303 | Regularized discriminant analysis
- Friedman
- 1989
(Show Context)
Citation Context ...ormance. 14sWe turn to the estimation of the conditional statistical models. The literature argues that maximum likelihood plug-in estimates may be suboptimal when the goal is prediction (Copas 1983; =-=Friedman 1989-=-). Gneiting, Westveld, Raftery and Goldman (2004) proposed the novel technique of minimum continuous ranked probability score (CRPS) estimation for estimating predictive distributions. In minimum CRPS... |

236 | Evaluating density forecasts with applications to …nancial risk management - Diebold, Gunther, et al. - 1998 |

228 |
Numerical Recipes in FORTRAN: The Art of Scientific Computing. Cambridge Univ
- Press, Teukolsky, et al.
- 1992
(Show Context)
Citation Context ...me, for instance, we find the minimum of the CRPS value as a function of the parameters in (10) and (11). This needs to be done numerically, and we use the Broyden-Fletcher-Goldfarb-Shanno algorithm (=-=Press et al. 1992-=-, Section 10.7) as implemented in the R language and environment (www.cran.r-project.org). The algorithm is iterative, and starting values based on past experience usually give good solutions. Converg... |

221 | Estimation of Relationships for Limited Dependent Variables - Tobin - 1958 |

175 | Remarks on a multivariate transformation - Rosenblatt - 1952 |

171 | Statistical theory: the prequential approach - Dawid - 1984 |

156 |
Rational decisions
- GOOD
- 1952
(Show Context)
Citation Context ... score is proper in the sense that the forecaster maximizes the expected score for an observation drawn from F if she issues the probabilistic forecast F , rather than G �= F . The logarithmic score (=-=Good 1952-=-; Bernardo 1979; Roulston and Smith 2002) is a proper scoring rule, too, but it is highly sensitive to outliers and difficult to interpret for mixed discrete-continuous predictive distributions. There... |

151 | Strictly proper scoring rules, prediction, and estimation
- Gneiting, Raftery
- 2007
(Show Context)
Citation Context ...arameters, and minimize that function with respect to the parameter values. This technique is tailored to probabilistic forecasting and can be interpreted within the framework of robust M-estimation (=-=Gneiting and Raftery 2004-=-). Here the predictive distributions are cut-off normal and we minimize the CRPS value (2), where each term is computed from (5). For RST-D-CH forecasts in the easterly regime, for instance, we find t... |

101 | Space-time modelling with long-memory dependence: assessing Ireland's wind power resource - Haslett, Raftery - 1989 |

84 |
Time Series. Theory and Methods (Second Edition
- Brockwell, Davis
- 1991
(Show Context)
Citation Context ...t−1 + a3Kt + a4Kt−1 + a5Gt, (9) where Vt, Kt, and Gt denote the wind speed at Vansycle, Kennewick and Goodnoe Hills at time t, respectively. This is akin to a vector autoregressive time series model (=-=Brockwell and Davis 1991-=-, Chapter 11; de Luna and Genton 2003) or an autoregressive distributed lag scheme (Zivot and Wang 2003, Section 6.4). However, the predictive distribution is cut-off Gaussian, and the model applies i... |

81 | Nonlinear Gated Experts for Time Series: Discovering Regimes and Avoiding Overfitting - Weigend, Mangeas, et al. - 1995 |

72 | Using bayesian model averaging to calibrate forecast ensembles - Raftery, Gneiting, et al. - 2005 |

71 |
Expected information as expected utility
- Bernardo
- 1979
(Show Context)
Citation Context ...roper in the sense that the forecaster maximizes the expected score for an observation drawn from F if she issues the probabilistic forecast F , rather than G �= F . The logarithmic score (Good 1952; =-=Bernardo 1979-=-; Roulston and Smith 2002) is a proper scoring rule, too, but it is highly sensitive to outliers and difficult to interpret for mixed discrete-continuous predictive distributions. Therefore, we assess... |

50 | A non-homogeneous hidden Markov model for precipitation occurence - Hughes, Guttorp, et al. - 1999 |

44 | Forecasting uncertainties in macroeconomic modelling: An application to the UK economy - Garratt, Lee, et al. - 2003 |

39 | Nonseparable, stationary covariance functions for space-time data - Gneiting - 2002 |

32 | Calibrated probabilistic forecasting using ensemble model output statistics and minimum CRPS estimation - Gneiting, Raftery, et al. - 2005 |

31 | Evaluating probabilistic forecasts using information theory
- Roulston, Smith
(Show Context)
Citation Context ...nse that the forecaster maximizes the expected score for an observation drawn from F if she issues the probabilistic forecast F , rather than G �= F . The logarithmic score (Good 1952; Bernardo 1979; =-=Roulston and Smith 2002-=-) is a proper scoring rule, too, but it is highly sensitive to outliers and difficult to interpret for mixed discrete-continuous predictive distributions. Therefore, we assess probabilistic forecasts ... |

30 |
Decomposition of the Continuous Ranked Probability Score for Ensemble Prediction
- Hersbach
- 2000
(Show Context)
Citation Context ...ed probability score is defined as crps(F, x) = � ∞ −∞ , (F (y) − 1(y ≥ x)) 2 dy, (1) 4swhich equals the integral of the Brier scores for binary probabilistic forecasts at all real-valued thresholds (=-=Hersbach 2000-=-). Gneiting and Raftery (2004) used a result of Székely (2003) to show that crps(F, x) = EF |X − x| − 1 2 EF � � ′ X − X � � , where X and X ′ are independent copies of a random variable with distribu... |

29 | A class of stochastic models for relating synoptic atmospheric patterns to local hydrologic phenomenon - Hughes, Guttorp - 1994 |

25 |
prediction and shrinkage
- COPAS
- 1983
(Show Context)
Citation Context ...dictive performance. 14sWe turn to the estimation of the conditional statistical models. The literature argues that maximum likelihood plug-in estimates may be suboptimal when the goal is prediction (=-=Copas 1983-=-; Friedman 1989). Gneiting, Westveld, Raftery and Goldman (2004) proposed the novel technique of minimum continuous ranked probability score (CRPS) estimation for estimating predictive distributions. ... |

24 | Space-time model for daily rainfall using atmospheric circulation patterns - Bardossy, Plate - 1992 |

22 |
2002: The economic value of ensemble forecasts as a tool for risk assessment: From days to decades
- Palmer
(Show Context)
Citation Context ...c in nature, taking the form of probability distributions over future events. Indeed, over the past two decades probabilistic forecasts have become routine in applications such as weather prediction (=-=Palmer 2002-=-; Gel, Raftery and Gneiting 2004) and macroeconomic forecasting (Garrat, Lee, Pesaran and Shin 2003). A probabilistic forecast for a real-valued quantity, such as wind speed or wind power, takes the f... |

21 | A latent gaussian markov random field model for spatio-temporal rainfall disaggregation
- Allcroft, Glasbey
(Show Context)
Citation Context ...d the associated tobit model has been widely used in econometric applications since. Cut-off normal distributions can also be interpreted in terms of latent Gaussian variables (Sansó and Guenni 2000; =-=Allcroft and Glasbey 2003-=-). 3 Data We introduce and describe the data on which our case study is based. 3.1 The meteorological towers at Vansycle, Kennewick and Goodnoe Hills The meteorological data used hereinafter were coll... |

20 | Time series models to simulate and forecast wind speed and wind power. Journal of climate and applied meteorology - Brown, Katz, et al. - 1984 |

20 |
The state-of-the-art in short-term prediction of wind power: A literature overview
- Giebel, Brownsword, et al.
- 2011
(Show Context)
Citation Context ... to the series of hourly average wind speed at Goodnoe Hills, fit and extracted a diurnal trend component, and modeled the residual component as an AR process. This approach has found widespread use (=-=Giebel 2003-=-). For the forecasts at Vansycle, we experimented with the square root transform of Brown et al. (1984) and the more general transform proposed by Allcroft and Glasbey (2003), but found forecasts base... |

19 | Calibrated probabilistic mesoscale weather field forecasting: The geostatistical output perturbation method - Gel, Raftery, et al. |

14 | Ozone exposure and population density in Harris County, Texas - Carroll, Chen, et al. - 1997 |

13 | Wind speed and power forecasting based on spatial correlation models - Alexiadis, Dokopoulos, et al. - 1999 |

13 |
A non-stationary multi-site model for rainfall
- Sanso, Guenni
(Show Context)
Citation Context ...ctive distributions, and the associated tobit model has been widely used in econometric applications since. Cut-off normal distributions can also be interpreted in terms of latent Gaussian variables (=-=Sansó and Guenni 2000-=-; Allcroft and Glasbey 2003). 3 Data We introduce and describe the data on which our case study is based. 3.1 The meteorological towers at Vansycle, Kennewick and Goodnoe Hills The meteorological data... |

8 | Probabilistic wind power forecasts using local quantile regression - Bremnes |

8 | Predictive spatio-temporal models for spatially sparse environmental data. Statist. Sinica 15 547–568. MR2190219 - Luna, X, et al. - 2005 |

7 | Weather Forecasting for Weather Derivatives, working paper - Campbell, Diebold - 2000 |

7 | ǫ-statistics: The energy of statistical samples - Székely - 2003 |

6 | Verifying probabilistic forecasts: Calibration and sharpness - Gneiting, Raftery, et al. - 2003 |

6 | Modeling transport effects on ground-level ozone using a non-stationary space-time model - Huang, Hsu - 2004 |

6 | Quality assurance procedures in the Oklahoma Mesonet - Shafer, Fiebrich, et al. - 2000 |

5 | 2001: The Impact of Unique Meteorological Phenomena Detected by the Oklahoma Mesonet and ARS Micronet on Automated Quality Control - Fiebrich, Crawford |

5 | On-line assessment of prediction risk for wind power production forecasts. Wind Energy 2004;7:119e32 - Pinson, Kariniotakis |

5 | Output power correlation between adjacent wind power plants - Wan, Milligan, et al. - 2003 |

4 | Modeling the variability of Sydney Harbor wind measurments - Cripps, Dunsmuir |

4 | 2004: Neural network classifiers for local wind prediction - Kretzschmar, Eckert, et al. |

3 |
Initial results of a mesoscale short-range forecasting system over the Pacific Northwest Wea. Forecasting 17
- Grimit, Mass
- 2002
(Show Context)
Citation Context ...n the introduction, numerical weather prediction (NWP) forecasts are not competitive at the forecast lead time that we consider here. However, NWP forecasts and mesoscale ensemble prediction systems (=-=Grimit and Mass 2002-=-) may provide independent information that could be used in the form of additional predictor variables for the conditional linear models, in identifying the forecast regimes, or in assessing and model... |

3 | A new reference for wind power forecasting - Nielsen, Joensen, et al. - 1998 |

3 | Using Medium Range Weather Forecasts to Improve the Value of Wind Energy Production - Kaplan, Hardenberg, et al. - 2003 |

3 |
2002: Columbia Gorge gap flow – Insights from observational analysis and ultra-high-resolution
- Sharp, Mass
(Show Context)
Citation Context ...ts is known as gap flow. The Columbia Gorge gap flow plays a profound role in defining the weather and climate within and near the Gorge, which is one of the windiest places in the Pacific Northwest (=-=Sharp and Mass 2002-=-, 200x). When the surface pressure is higher to the west, the flow within the gorge is normally westerly; conversely, when there is higher pressure to the east, the wind is usually easterly. Westerly ... |

3 | A dimension reduction approach to space-time Kalman filtering - Wikle, Cressie - 1999 |

1 | Improving wind energy forecasts - Larson, Gneiting - 2004 |