You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

brazil84 comments on Weather and climate forecasting: how the challenges differ by time horizon - Less Wrong Discussion

6 Post author: VipulNaik 04 July 2014 03:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1)

You are viewing a single comment's thread.

Comment author: brazil84 05 July 2014 07:34:34PM 3 points [-]

When it comes to Seasonal-to-Interannual forecasting, we have two possible benchmarks: Previous year's seasonal weather. Historical average climate for that season.

Well you could also add a correction for the measured trend over a longer time period. For example, one can observe that temperature has been generally trending upwards since around 1900, i.e. as the Earth has emerged from the Little Ice Age. In making a basic benchmark prediction, it's reasonable to assume that this trend will continue.

This becomes more of an issue for long-range forecasting, because even if the model does not explicitly use the data it is trying to predict, the researchers working on the model are implicitly aware of the information

I agree, and there also is the file drawer problem, i.e. if a simulation doesn't match history it will be quietly discarded. So when you are presented with a simulation which does match history, you don't know how many simulations were discarded to get to that one. So you don't know how impressive it is that the simulation matches history. Until of course you wait for a few years, observe that the simulation diverges wildly, and conclude that its beautiful fit with history is not very impressive at all.