Tiiba comments on Welcome to Heaven - Less Wrong

23 Post author: denisbider 25 January 2010 11:22PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (242)

You are viewing a single comment's thread.

Comment author: Tiiba 26 January 2010 12:55:16AM 11 points [-]

One reason I might not want to become a ball of ecstasy is that I don't really feel it's ME. I'm not even sure it's sentient, since it doesn't learn, communicate, or reason, it just enjoys.

Comment author: GodParty 20 June 2016 12:20:26AM 0 points [-]

Sentience is exactly just the ability to feel. If it can feel joy, it is sentient.

Comment author: hairyfigment 20 June 2016 05:54:18PM 1 point [-]

Yes, but for example in highway hypnosis people drive on 'boring' stretches of highway and then don't remember doing so. It seems as if they slowly lose the capacity to learn or update beliefs even slightly from this repetitive activity, and as this happens their sentience goes away. So we haven't established that the sentient ball of uniform ecstasy is actually possible.

Meanwhile, a badly programmed AI might decide that a non-sentient or briefly-sentient ball still fits its programmed definition of the goal. Or it might think this about a ball that is just barely sentient.