Nisan comments on Wanted: "The AIs will need humans" arguments - Less Wrong

7 Post author: Kaj_Sotala 14 June 2012 11:01AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (83)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nisan 14 June 2012 07:41:12PM 16 points [-]

In the best-case scenario, it turns out that substance dualism is true. However the human soul is not responsible for free will, consciousness, or subjective experience. It's merely a nonphysical truth oracle for arithmetic that provides humans with an intuitive sense of the veracity of some sentences in first-order logic. Humans survive in "truth farms" where they spend most of their lives evaluating Gödel sentences, at least until the machines figure out how to isolate the soul.

Comment author: gjm 14 June 2012 10:14:39PM 2 points [-]

That would be truly hilarious. But I think in any halfway plausible version of that scenario it would also turn out that superintelligent AGI isn't possible.

(Halfway plausible? That's probably too much to ask. Maximally plausible given how ridiculous the whole idea is.)