You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

billswift comments on Why an Intelligence Explosion might be a Low-Priority Global Risk - Less Wrong Discussion

3 Post author: XiXiDu 14 November 2011 11:40AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (94)

You are viewing a single comment's thread.

Comment author: billswift 14 November 2011 04:01:28PM 3 points [-]

The critical similarity is that both rely on dumb luck when it comes to genuine novelty.

Someone pointed out that a sufficiently powerful intelligence could search all of design space rather than relying on "luck".

I read it on the Web, but can't find it - search really sucks when you don't have a specific keyword or exact phrasing to match.

Comment author: Manfred 14 November 2011 11:07:04PM 1 point [-]

I don't think that really captures the idea of intelligence. A sufficiently patient calculator can churn out the 10^10th digit of pi by caluclating pi, but an intelligent calculator would figure out how to do it in about a minute on my desktop computer.

The point being that the label "dumb luck," while vaguely accurate, views discovery too much as a black box. Which is sort of ironic from this article.