polymathwannabe comments on What is the difference between rationality and intelligence? - Less Wrong

11 Post author: Wei_Dai 13 August 2014 11:19AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (51)

You are viewing a single comment's thread. Show more comments above.

Comment author: polymathwannabe 13 August 2014 08:45:45PM 7 points [-]

Intelligence/muscles = a natural faculty every human is born with, in greater or lesser degree.

Rationality/gymastics = a teachable set of techniques that help you refine what you can do with said natural faculty.

Comment author: Viliam_Bur 15 August 2014 08:18:28AM *  1 point [-]

Probably this explains why the distinction between intelligence and rationality makes sense for humans (where some skills are innate, and some skills are learned), but doesn't necessarily make sense for self-improving AIs.

Intelligence is about our biological limits, which determine how much optimizing power we can produce in short term (on the scale of seconds), which is more or less fixed. Rationality is about using this optimizing power over long term. Intelligence is how much "mental energy" you can generate per second. Rationality is how you use this energy, if you are able to accumulate it, etc.

Seems like in humans, most of this generated energy is wasted, so there can be a great difference between how much "mental energy" you can generate per second, and whether you can accumulate enough "mental energy" to reach your life goals. (Known as: "if you are so smart, why aren't you rich?") A hypothetical perfect Bayesian machine could use all the "mental energy" efficiently, so there would be some equation connecting its intelligence and rationality.