Dorikka comments on Discussion: Which futures are good enough? - Less Wrong

5 Post author: WrongBot 24 February 2013 12:06AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (50)

You are viewing a single comment's thread.

Comment author: Dorikka 24 February 2013 01:27:58AM 8 points [-]

(Unless you mind being simulated, in which case at least you'll never know.)

If I paid you to extend the lives of cute puppies, and instead you bought video games with that money but still sent me very convincing pictures of cute puppies that I had "saved", then you have still screwed me over. I wasn't paying for the experience of feeling that I had saved cute puppies -- I was paying for an increase in the probability of a world-state in which the cute puppies actually lived longer.

Tricking me into thinking that the utility of a world state that I inhabit is higher than it actually is isn't Friendly at all.

Comment author: Lightwave 24 February 2013 10:53:47AM 4 points [-]

I, on the other hand, (suspect) I don't mind being simulated and living in a virtual environment. So can I get my MFAI before attempts to build true FAI kill the rest of you?

Comment author: ikrase 27 February 2013 10:12:10PM 1 point [-]

Possible compromise: Have there be some way of revealing the truth to those who want the truth badly enough.

I am extremely hostile to this idea. (I'm not dead-set against forced uploading or even hidden forced uploading (though I would prefer to keep the interface to the base universe open) but I cannot tolerate this end of interpersonal entanglement.