I think to this approach to be beneficial the predictions would need to be much more narrowly defined that described here. Things along the lines or Offence will rush or pass or even more fine grained such as rush to short side of the field with tackle pulling, rush with sweep and back up of a pitchback. For passing some idea about receiver type -- wide or one of the backs -- as well as how deep. For punts and kick-offs perhaps things like what receiver is targeted or take away option to return, or for punts various fake play scenario.
If we just say "succeed" I'm not sure what we're really testing as we don't seem to be saying anything about the play to be executed so seems like the success/fail results will have a lot of noise in them.
I do agree that sports offers a great environment for such efforts for the reasons you've listed. So perhaps just adding clarifying points here.
American football has some properties that make it useful for practicing making predictions:
I've created a forecasting practice exercise that you can do while watching a game, either on paper or using this spreadsheet.
For those with no idea how football works, there's a decent basic intro here.
Instructions
Before each down, write down the probability that the current frame will succeed (result in a first down or a touchdown). Once the frame finishes, write the outcome next to your prediction. Repeat.
Optionally, on the special plays (kickoff, punt, field goal attempt, and 2 point attempt), predict whether that play will succeed, and then write down the outcome.
For a field goal or 2 point attempt, success or failure is clear: the team attempting to score either does or doesn't.
For punts and kickoffs, there isn't a sharp dividing line between success and failure, but one definition you can use is that the kick is "successful" if the result is better for the kicking team than a touchback.