Vladimir_Nesov comments on Not for the Sake of Pleasure Alone - Less Wrong

36 Post author: lukeprog 11 June 2011 11:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (129)

You are viewing a single comment's thread.

Comment author: Vladimir_Nesov 12 June 2011 12:06:02AM 16 points [-]

I wonder how much taking these facts into account helps. The error that gets people round up to simplistic goals such as "maximize pleasure" could just be replayed at a more sophisticated level, where they'd say "maximize neural correlates of wanting" or something like that, and move to the next simplest thing that their current understanding of neuroscience doesn't authoritatively forbid.

Comment author: lukeprog 12 June 2011 12:41:29AM *  9 points [-]

Sure. And then I write a separate post to deal with that one. :)

There are also more general debunkings of all such 'simple algorithm for friendly ai' proposals, but I think it helps to give very concrete examples of how particular proposed solutions fail.

Comment author: Miller 12 June 2011 09:41:38AM 1 point [-]

Sounds like a decent methodology to me.

Comment author: poh1ceko 18 June 2011 04:02:16AM 0 points [-]

It helps insofar as the person's conscious mind lags behind in awareness of the object being maximized.

Comment author: [deleted] 14 June 2014 05:17:46AM -1 points [-]

''Moore proposes an alternative theory in which an actual pleasure is already present in the desire for the object and that the desire is then for that object and only indirectly for any pleasure that results from attaining it. "In the first place, plainly, we are not always conscious of expecting pleasure, when we desire a thing. We may only be conscious of the thing which we desire, and may be impelled to make for it at once, without any calculation as to whether it will bring us pleasure or pain. In the second place, even when we do expect pleasure, it can certainly be very rarely pleasure only which we desire.''