I suggest the following model. Consider yourself to be an agent of fixed optimization power but variable utility function. Then, "things under your control" are things that can be affected by the choice of the utility function.

In this model IQ is an external factor. But choosing to eat toast or cereals for breakfast is an internal factor. I think this corresponds better to the intuitive notion of internal/external factors.