There's really no downside to letting people use the bathroom more often. It doesn't harm me at all if my neighbor decides to violate the stricture.
If the punishment for murder is removed, or the belief that murder will be punished ceases to be generally retained, then it is entirely likely that my neighbor may wish to murder *me*, and that decision has lots of consequences that concern me greatly.
People who believe that societal indoctrination is necessary to get people to accept certain principles, and that religion is an essential part of that indoctrination, will object to the removal of the threat of god-punishment. Without that threat, they believe societal habit alone won't be enough to keep them safe.
They may be right - when societal controls are relaxed, people act pretty nastily towards each other. Primates are nasty beings.
Subscribe to RSS Feed
= f037147d6e6c911a85753b9abdedda8d)
Well, I certainly agree that all else being equal we ought not kill X if there's a doubt about whether X is a person or not, and I support building AIs in such a way that they also agreed with that.
But if for whatever reason I'm in a scenario where only one of X and Y can survive, and I believe X is a person and Y is not, and the AI says that Y is a person and X is not, and I'm the one who has to decide which of X and Y to destroy, then I need to decide whether I trust my own judgment more than the AI's judgment, or less.
And obviously that's going to depend on the particulars of X, Y, me, and the AI... but it's certainly possible that I might in that situation update my beliefs and destroy X instead of Y.
Hmm