If he's somewhat like Eliezer at an earlier age, he might think a sufficiently smart AI might autonomously figure out the "meaning of life".
I'd take CEV over that, though it'd make an interesting ending.
I'd take CEV over that, though it'd make an interesting ending.
So would I. (And I note that CEV is fine, so long as it is the coherent extrapolated voilition of the right group. Preferably me but I'm willing to compromise. :P)
Update: This post has also been superseded - new comments belong in the latest thread.
The second thread has now also exceeded 500 comments, so after 42 chapters of MoR it's time for a new thread.
From the first thread: