ArisKatsaris comments on Policy Debates Should Not Appear One-Sided - Less Wrong

102 Post author: Eliezer_Yudkowsky 03 March 2007 06:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (179)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: ArisKatsaris 18 January 2013 04:49:33PM *  2 points [-]

We must indeed use rules as a matter of practical necessity, but it's just that: a matter of practical necessity. We can't model the entirety of our future lightcone in sufficient detail so we make generic rules like "do not lie" "do not murder" "don't violate the rights of others" which seem to be more likely to have good consequences than the opposite.

But the good consequences are still the thing we're striving for -- obeying rules is just a means to that end, and therefore can be replaced or overriden in particular contexts where the best consequences are known to be achievable differently...

A consequentialist is perhaps a bit scarier in the sense that you don't know if they'll stupidly break some significant rule by using bad judgment. But a deontologist that follows rules can likewise be scary in blindly obeying a rule which you were hoping them to break.

In the case of super-intelligent agents that shared my values, I'd hope them to be consequentialists. As intelligence of agent decreases, there's assurance in some limited type of deontology... "For the good of the tribe, do not murder even for the good of the tribe..."

Comment author: Peterdjones 18 January 2013 05:42:30PM 0 points [-]

That's the kind of Combination approach I was arguing for.

Comment author: DaFranker 18 January 2013 06:14:07PM 0 points [-]

My understanding of pure Consequentialism is that this is exactly the approach it promotes.

Am I to understand that you're arguing for consequentialism by rejecting "consequentialism" and calling it a "combination approach"?

Comment author: MugaSofer 20 January 2013 03:39:36PM 0 points [-]

That would be why he specified "simpler versions", yes?

Comment author: Peterdjones 20 January 2013 05:15:33PM 0 points [-]

Yes