Lumifer comments on Intelligence Amplification and Friendly AI - Less Wrong

13 Post author: lukeprog 27 September 2013 01:09AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (25)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 27 September 2013 04:29:55PM 1 point [-]

Increased intelligence does not mean increased rationality

Yes, it does. It's not a one-to-one (or linear) correspondence, but it's really hard to be rational if you're stupid.

Comment author: [deleted] 27 September 2013 08:53:49PM 1 point [-]

As a more technical elaboration, rationality is a computational process involving prioritized search. It's a specific software algorithm. “Intelligence augmentation” is not well defined, but generally involves increasing the computational power of an existing human brain, aka making the hardware faster. That says nothing about the software running on it. But it is easy to show that if you increase the computational power available to a rational agent, you get a more rational agent (but increasing the computational power available to a non-rational agent would not magically impart rationality).