Isn't time discounting mainly a result of risk aversion?

I think it is better to think of temporal discounting and risk aversion as orthogonal.

at what point does a rational agent stop its exploration and start the exploitation

Exploration vs expolitation is based on what the utility function says.