Arandur comments on The Goal of the Bayesian Conspiracy - Less Wrong

-9 Post author: Arandur 16 August 2011 06:40PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (80)

You are viewing a single comment's thread. Show more comments above.

Comment author: Arandur 16 August 2011 06:24:40AM 4 points [-]

Huh. An interesting point, and one that I should have considered. So what would you suggest as a safety hatch?

Comment author: dspeyer 16 August 2011 03:14:46PM 6 points [-]

I don't know, but I'll throw some ideas up. These aren't all the possibilities and probably don't include the best possibility.

Each step must be moral taken in isolation. No it'll-be-worth-it-in-ten-years reasoning, since that can go especially horribly wrong.

Work honestly within the existing systems. This allows existing safeguards to apply. On the other hand, it assumes it's possible to get anything done within existing systems by being honest.

Establish some mechanism to keep moral intuition. Secret-ballot mandatory does-this-feel-right votes.

Divide into several conspiracies, which are forbidden to have discuss issues with eachother, preventing groupthink.

Have an oversight conspiracy, with the power to shut us down if they believe we've gone evil.