You might find the table in this article useful to understand how payoffs vary over time: 

https://www.luca-dellanna.com/ergodicity