JamesAndrix comments on Sorting Pebbles Into Correct Heaps - Less Wrong

75 Post author: Eliezer_Yudkowsky 10 August 2008 01:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (100)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: DanielLC 20 November 2010 08:21:26PM 1 point [-]

I don't understand your point about killing them. An AI with my utility function would certainly kill me. There are more efficient arrangements of matter to produce utility.

Comment author: JamesAndrix 20 November 2010 09:24:27PM 6 points [-]

Keep reading the morality sequence, My comment came while I still had some confusions which are now dissolved.

I don't know what you count on utility, but I think an AI with your utility function would preserve that which makes you 'you' . (it might do anything with your old matter.) At least until it was ready to do something more interesting with 'you' .

Pebble sorters value only things that were not pebble sorters, humans value humans, among other things