lessdazed comments on A Rationalist's Tale - Less Wrong

82 Post author: lukeprog 28 September 2011 01:17AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (305)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 09 September 2011 11:11:29AM 10 points [-]

How do we know that designing a better intelligence is not an exponentially difficult task ?

Well, the answer could simply be, "you're right; we don't know that". However, I think there is evidence that an ultraintelligent machine could make itself very intelligent indeed.

The human mind, though better at reasoning than anything else that currently exists, still has a multitude of flaws. We can't symbolically reason at even a millionth the speed of a $15 cell phone (and even if we could, there are still unanswered questions about how to reason), and our intuition is loaded with biases. If you could eliminate all human flaws, you would end up with something more intelligent than the most intelligent human that has ever lived.

Also, I could be mistaken, but I think people who study rationality and mathematics (among other things?) tend to report increasing marginal utility: once they understand a concept, it becomes easier to understand other concepts. A machine capable of understanding trillions of concepts might be able to learn new ones very easily compared to a human.

Comment author: lessdazed 09 September 2011 11:16:36AM 7 points [-]

If you could eliminate all human flaws, you would end up with...

You might end up with nothing. You really have to start over and build an inference machine vastly different from ours.