Caspian comments on The Dark Arts - Preamble - Less Wrong

44 Post author: Aurini 11 October 2010 02:01PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (139)

You are viewing a single comment's thread.

Comment author: Caspian 15 October 2010 04:46:46PM 0 points [-]

I notice that I am confused. Manipulation may have occurred if someone's free will has been overridden. There was a nice post about the compatibility between free will and determinism, which I agree with, but I find the issue of manipulation shows I still have a fuzzy idea about what free will means.

The work on Friendly AI gives me a fairly good idea about how it's possible to avoid being manipulative to a person, but the answer - following their extrapolated volition - is much too high a standard. What if you want to be neutral rather than selflessly and altrusticly benevolent towards them?

Still, their extrapolated volition seems to be relevant.