deciding what to do in the real world requires non-rational value judgmentsIn

deed, this is why a rational paperclip maximizer would create as many paperclips as possible. (The difference between irrational and rational paperclip maximizers is that the latter has a better model of the world, and thus probably succeeds to create more paperclips on average.)

But here's the training in refining your values?