HopeFox comments on Sorting Pebbles Into Correct Heaps - Less Wrong

75 Post author: Eliezer_Yudkowsky 10 August 2008 01:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (100)

Sort By: Old

You are viewing a single comment's thread.

Comment author: HopeFox 24 April 2011 12:17:50AM 6 points [-]

What really struck me with this parable is that it's so well-written that I felt genuine horror and revulsion at the idea of an AI making heaps of size 8. Because, well... 2!

So, aside from the question of whether an AI would come to moral conclusions such as "heaps of size 8 are okay" or "the way to end human suffering is to end human life", the question I'm taking away from this parable is, are we any more enlightened than the Pebblesorters? Should we, in fact, be sending philosophers or missionaries to the Pebblesorter planet to explain to them that it's wrong to murder someone just because they built a heap of size 15?

Comment author: Luke_A_Somers 29 August 2011 10:21:38PM 1 point [-]

Maybe they just hadn't finished it yet…

Comment author: Coda 02 December 2012 11:26:15PM 9 points [-]

Why not keep it in the form of a pile of 13 and a pile of 2, until you find the other two pebbles you're looking for? That would be the ETHICALLY RESPONSIBLE thing to do!