MugaSofer comments on The $125,000 Summer Singularity Challenge - Less Wrong

20 Post author: Kaj_Sotala 29 July 2011 09:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (259)

You are viewing a single comment's thread. Show more comments above.

Comment author: MugaSofer 26 April 2013 11:24:09AM -1 points [-]

So ... if there are vast alien civilizations, murder is OK?

Comment author: CCC 26 April 2013 01:04:54PM 1 point [-]

No. Total utility still drops every time a person is killed, as long as f(x) is strictly monotonically increasing.

Comment author: MugaSofer 26 April 2013 01:32:05PM *  -2 points [-]

Wrong thread, mate.

I was replying to the idea that the marginal utility of not killing one person might be less than the utility of a cookie, if there are enough people.

Comment author: CCC 26 April 2013 01:42:03PM *  1 point [-]

That doesn't mean that it's OK. That means that it is seen as only very, very slightly not OK.

...unless you and I have different definitions of "OK", which I begin to suspect.

Comment author: MugaSofer 26 April 2013 02:04:22PM *  -2 points [-]

I have to admit, that was sloppily phrased. However, you do seem to be defining "OK" as equivalent to "actively good" whereas I'm using something more like "acceptable".

Comment author: CCC 26 April 2013 03:22:18PM 1 point [-]

Well, I'd accept strictly neutral (neither actively evil nor actively good) as OK as well. It seems that your definition of OK includes the possibility of active evil, as long as the amount of active evil is below a certain threshold.

It seems that we're in agreement here; whether or not it is "OK" is defined by the definitions we are assigning to OK, and not to any part of the model under consideration.

Comment author: MugaSofer 29 April 2013 10:22:47AM -1 points [-]

The threshold being whether I can be bothered to stop it. As I said, it was sloppy terminology - I should have said something like "worth less than the effort of telling someone to stop" or some other minuscule cost you would be unwilling to pay. Since any intervention, in real life, has a cost, albeit sometimes a small one, this seems like an important distinction.