Taboo "rational". If it means something like "being very good at gathering evidence about the world and finding which actions would produce which results", it is something we can program into the AI (in principle) but that seems unrelated to goals. If it means something else, which can be related to goals, then how would we create an AI that is "truly rational"?
I'm using the Wikipedia definition:
An action, belief, or desire is rational if we ought to choose it. Rationality is a normative concept that refers to the conformity of one's beliefs with one's reasons to believe, or of one's actions with one's reasons for action... A rational decision is one that is not just reasoned, but is also optimal for achieving a goal or solving a problem.
It's my view that a Strong A.I. would by definition be "truly rational". It would be able to reason and find the optimal means of achieving its goals. Furthermor...
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.