You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

shminux comments on Could you tell me what's wrong with this? - Less Wrong Discussion

1 Post author: Algon 14 April 2015 10:43AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (64)

You are viewing a single comment's thread. Show more comments above.

Comment author: shminux 17 April 2015 08:28:35PM *  0 points [-]

pop-comp-sci material like Superintelligence

Superintelligence is a broad overview of the topic without any aspirations for rigor, as far as I can tell, and it is pretty clear about that.

who simply assume that an AI will instantly gain any capability up to and including things which would require more energy than there exists in the universe or more computational power than would be available from turning every atom in the universe into computronium.

This seems uncharitable. The outside view certainly backs up something like

every jump in intelligence opens up new previously unexpected and unimaginable sources of energy.

Examples: fire, fossil fuels, nuclear. Same applies to computational power.

There is no clear reason for this correlation to disappear. Thus what we would currently deem

more energy than there exists in the universe

or

more computational power than would be available from turning every atom in the universe into computronium

might reflect our limited understanding of the Universe, rather than any kind of genuine limits.