Oscar_Cunningham comments on Does the universe contain a friendly artificial superintelligence? - Less Wrong

-12 Post author: DevilMaster 31 October 2013 01:01PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (5)

You are viewing a single comment's thread.

Comment author: Oscar_Cunningham 31 October 2013 06:22:57PM 3 points [-]

[1] We must assume that a FASI would not just reply "You silly creature, becoming omnipotent is not in your best interest so I will not make you omnipotent because I know better" (or an equivalent thereof). If we did, we would implicitly consider the absence of omnipotent beings as evidence for the presence of a FASI. This would force us to consider the eventual presence of omnipotent beings as evidence for the absence of a FASI, which would not make sense.

Nope. The fact that observing near-omnipotent beings would increase the probability of AI doesn't mean that the probability of near-omnipotent beings is high given AI, it just means that it's high relative to the probability of observing near-omnipotent beings without the existence of AI.

Also, note that the universe has a lightspeed limit that might well not be breakable, even by superintelligences.