billswift comments on Why an Intelligence Explosion might be a Low-Priority Global Risk - Less Wrong

3 Post author: XiXiDu 14 November 2011 11:40AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (94)

You are viewing a single comment's thread.

Comment author: billswift 14 November 2011 04:01:28PM 3 points [-]

The critical similarity is that both rely on dumb luck when it comes to genuine novelty.

Someone pointed out that a sufficiently powerful intelligence could search all of design space rather than relying on "luck".

I read it on the Web, but can't find it - search really sucks when you don't have a specific keyword or exact phrasing to match.

Comment author: Manfred 14 November 2011 11:07:04PM 1 point [-]

I don't think that really captures the idea of intelligence. A sufficiently patient calculator can churn out the 10^10th digit of pi by caluclating pi, but an intelligent calculator would figure out how to do it in about a minute on my desktop computer.

The point being that the label "dumb luck," while vaguely accurate, views discovery too much as a black box. Which is sort of ironic from this article.