Comment author: Vladimir_Slepnev 15 October 2008 10:17:14AM 1 point [-]

What if a AI decides, with good reason, that it's running on hostile hardware?

Comment author: Vladimir_Slepnev 29 June 2008 07:51:00PM 0 points [-]

Eliezer, if I lose all my goals, I do nothing. If I lose just the moral goals, I begin using previously immoral means to reach my other goals. (It has happened several times in my life.) But your explaining won't be enough to take away my moral goals. Morality is desire conditioned by examples in childhood, not hard logic following from first principles. De-conditioning requires high stress, some really bad experience, and the older you get, the more punishment you need to change your ways.

Sebastian Hagen, people change. Of course you may refuse to accept it, but the current you will be dead in a second, and a different you born. There's a dead little girl in every old woman.

View more: Prev