NMJablonski comments on The Amazing Virgin Pregnancy - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (271)
So, we're working with thomblake's definition of "wrong" as those actions which reduce utility for whatever function an agent happens to care about. The aliens care about themselves not being exterminated, but may actually assign very high utility to humans being wiped out.
Perhaps we would be viewed as pests, like rats or pigeons. Just as humans can assign utility to exterminating rats, the aliens could do so for us.
Exterminating humans has the objectively determinable outcome of reducing the utility in your subjectively privileged function.
Inasmuch as we are talking about objective rightness we are talking are not talking about utility functions, because not everyone is running of the same utility function, and it makes sense to say some UFs are objectively wrong.
What would it mean for a utility function to be objectively wrong? How would one determine that a utility function has the property of "wrongness"?
Please, do not answer "by reasoning about it" unless you are willing to provide that reasoning.
I did provide the reasoning in the alien example.
Let's break this all the way down. Can you give me your thesis?
I mean, I see there is a claim here:
... of the format (X therefore Y). I can understand what the (X) part of it means: aliens with a preference not to be destroyed. Now the (Y) part is a little murky. You're saying that the truth of X implies that they "should not exterminate". What does the word should mean there?