Comment author: djadvance22 29 December 2011 12:09:08PM *  4 points [-]

Your dirty list is gross. Organize it with some sort of taxonomy, it will help to visualize what's missing from the list, and to prioritize from there.

In response to Welcome to Heaven
Comment author: mkehrt 25 January 2010 11:53:22PM 27 points [-]

I think you are missing the point.

First throw out the FAI part of this argument; we can consider an FAI just as a tool to help us achieve our goals. Any AI which does not do at least this this is insufficiently friendly (and thus counts as a paperclipper, possibly).

Thus, the actual question is what are our goals? I don't know about you, but I value understanding and exploration. If you value pleasure, good! Have fun being a wirehead.

It comes down to the fact that a world where everyone is a wirehead is not valued by me or probably by many people. Even though this world would maximize pleasure, it wouldn't maximize utility of people designing the world (I think this is the util/hedon distinction, but I am not sure). If we don't value that world, why should we create it, even if we would value after we create it?

In response to comment by mkehrt on Welcome to Heaven
Comment author: djadvance22 29 January 2010 01:23:22AM 5 points [-]

The way I see it is that there is a set of preferable reward qualia we can experience (pleasure, wonder, empathy, pride) and a set of triggers attached to them in the human mind (sexual contact, learning, bonding, accomplishing a goal). What this article says is that there is no inherent value in the triggers, just in the rewards. Why rely on plugs when you can short circuit the outlet?

But that is missing an entire field of points: there are certain forms of pleasure that can only be retrieved from the correct association of triggers and rewards. Basking in the glow of wonder from cosmological inquiry and revelation is not the same without an intellect piecing together the context. You can have bliss and love and friendship all bundled up into one sensation, but without the STORY, without a timeline of events and shared experience that make up a relationship, you are missing a key part of that positive experience.

tl;dr: Experiencing pure rewards without relying on triggers is a retarded (or limited) way of experiencing the pleasures of the universe.