You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

John_Maxwell_IV comments on Stupid Questions Open Thread - Less Wrong Discussion

42 Post author: Costanza 29 December 2011 11:23PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (265)

You are viewing a single comment's thread. Show more comments above.

Comment author: John_Maxwell_IV 27 March 2012 06:53:20PM 0 points [-]

It seems likely to me that the CEV of the 30-year-old would be friendly and the CEV of the three-year-old would not be, but as you say at this point it's hard to say much for sure.

Comment author: TheOtherDave 27 March 2012 07:30:55PM 1 point [-]

(nods) That follows from what you've said earlier.

I suspect we have very different understandings of how similar the 30-year-old's desires are to their volition.

Perhaps one way of getting at that difference is thus: how likely do you consider it that the CEV of a 30-year-old would be something that, if expressed in a form that 30-year-old can understand (say, for example, the opportunity to visit a simulated world for a year that is constrained by that CEV), would be relatively unsurprising to that 30-year-old... something that would elicit "Oh, cool, yeah, this is more or less what I had in mind" rather than "Holy Fucking Mother of God what kind of an insane world IS this?!?"?

For my own part, I consider the latter orders of magnitude more likely.

Comment author: John_Maxwell_IV 27 March 2012 07:38:13PM 0 points [-]

I'm pretty uncertain.