Lumifer comments on Ethics in a Feedback Loop: A Parable - Less Wrong

9 Post author: PeerGynt 25 July 2014 04:25PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (136)

You are viewing a single comment's thread. Show more comments above.

Comment author: PeerGynt 25 July 2014 10:10:57PM 0 points [-]

I am a moral realist, I believe there exists an objective moral standard which is part of the territory. This is the moral standard we are talking about.

Obviously, we are unable to know whether our ethical maps correspond to the ethical territory. We should therefore update our priors about the ethical territory in response to good arguments and thought experiments. Throughout this discussion, I have made several updates to my beliefs.

If we don't believe there is such a thing as an objective ethical standard, if the territory doesn't exist, then I fail to see the point in even discussing ethics.

Comment author: Lumifer 26 July 2014 01:22:08AM 3 points [-]

I believe there exists an objective moral standard which is part of the territory. ... Obviously, we are unable to know whether our ethical maps correspond to the ethical territory.

Hold on. You're saying that there's objective morality but it's unknowable in principle? Then on what basis do you believe it exists and why would its existence even matter?

If we don't believe there is such a thing as an objective ethical standard ... then I fail to see the point in even discussing ethics.

Even if you think that ethics are a semi-arbitrary social construct, they are very useful for human societies and so worth discussing.

Comment author: PeerGynt 26 July 2014 01:33:56AM *  0 points [-]

Fair point - I should have phrased that differently. I think I intended that both in the weak sense "Our prior on moral statements should never be 0 or 1" and also in the slightly stronger sense "Ethics is difficult, so our priors should have high variance"

Comment author: Lumifer 26 July 2014 01:46:59AM 2 points [-]

The problem isn't so much with priors, the problem is what are you willing to accept as evidence to be used for updating your beliefs.