nazgulnarsil comments on Separate morality from free will - Less Wrong

6 Post author: PhilGoetz 10 April 2011 02:35AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (84)

You are viewing a single comment's thread.

Comment author: nazgulnarsil 08 April 2011 11:07:21AM *  -2 points [-]

to me, morality means not disastrously/majorly subverting another's utility function for a trivial increase in my own utility.

edit: wish the downvoters would give me some concrete objections.

Comment author: Dorikka 10 April 2011 03:17:27AM *  1 point [-]

Do you mean that "not disastrously/majorly subverting another's utility function for a trivial increase in my own utility" is ethical, in the sense that this is a safety measure so that you don't accidentally cause net negative utility with regard to your own utility function (as a result of limited computing power)?

Or do you mean that you assign negative utility to causing someone else negative utility according to their utility function?

Comment author: nazgulnarsil 10 April 2011 03:48:18AM 2 points [-]

causing negative utility is not the same as disastrously subverting their utility function.

Comment author: Jonathan_Graehl 11 April 2011 10:35:11PM 2 points [-]

It's strange that you haven't explained what you mean by 'disastrously subverting'.

Comment author: nazgulnarsil 12 April 2011 12:11:13AM 3 points [-]

slipping the pill that makes you want to kill people into gandhi's drink without his knowledge is the simplest example.

Comment author: Jonathan_Graehl 12 April 2011 12:53:15AM 2 points [-]

Now I just think it's odd that you have "refraining from non-consensual modification of others' wants/values" as the sole meaning of "morality".

Comment author: wedrifid 12 April 2011 03:28:03AM *  0 points [-]

The "it is strange", "I think it is odd" style of debate struck me as disingenuous.

Comment author: Jonathan_Graehl 12 April 2011 07:56:17AM 0 points [-]

Okay, "stupid" if you prefer :)

Comment author: wedrifid 12 April 2011 08:21:09AM 1 point [-]

Better. :)

Comment author: Jonathan_Graehl 12 April 2011 04:38:11PM 1 point [-]

to me, morality means not disastrously/majorly subverting another's utility function for a trivial increase in my own utility.

I was really just annoyed at the lack of clarity in that statement. I could have just said so, in fewer words (or said nothing).

Your critique was justified, and your less presumptuous "struck me as" made it easier for me to think rather than argue.

Comment author: TheOtherDave 12 April 2011 12:01:23PM 0 points [-]

If we're just talking about rhetoric here, I prefer "odd" to "stupid" but would prefer "wrong" or "unjustified" (depending on which one you actually mean) to either.

Comment author: zaph 08 April 2011 12:09:32PM 0 points [-]

That strikes me as a low bar. Would you disastrously subvert someone else's utility function to majorly increase yours?

Comment author: nazgulnarsil 08 April 2011 06:45:20PM *  -1 points [-]

depends. no hard and fast rule. http://www.youtube.com/watch?v=KiFKm6l5-vE

Comment author: khafra 08 April 2011 04:48:27PM -1 points [-]

"Subversion" seems unspecific. Does that mean, would I go back in time and use my amazing NLP powers or whatever to convince Hitler to try art school again instead of starting a world war and putting millions into death camps? Or is this "subversion" more active and violent?

Comment author: nazgulnarsil 08 April 2011 06:44:44PM -1 points [-]

it goes both ways. those who try to disastrously subvert others as part of their utility get less moral consideration.