You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

danieldewey comments on Polymath-style attack on the Parliamentary Model for moral uncertainty - Less Wrong Discussion

22 Post author: danieldewey 26 September 2014 01:51PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (74)

You are viewing a single comment's thread. Show more comments above.

Comment author: danieldewey 28 September 2014 01:44:56PM 3 points [-]

Great example. As an alternative to your three options (or maybe this falls under your first bullet), maybe negotiation should happen behind a veil of ignorance about what decisions will actually need to be made; the delegates would arrive at a decision function for all possible decisions.

Your example does make me nervous, though, on the behalf of delegates who don't have much to negotiate with. Maybe (as badger says) cardinal information does need to come into it.

Comment author: owencb 28 September 2014 02:51:01PM *  3 points [-]

Yes, I think we need something like this veil of ignorance approach.

In a paper (preprint) with Ord and MacAskill we prove that for similar procedures, you end up with cyclical preferences across choice situations if you try to decide after you know the choice situation. The parliamentary model isn't quite within the scope of the proof, but I think more or less the same proof works. I'll try to sketch it.

Suppose:

  • We have equal credence in Theory 1, Theory 2, and Theory 3
  • Theory 1 prefers A > B > C
  • Theory 2 prefers B > C > A
  • Theory 3 prefers C > A > B

Then in a decision between A and B there is no scope for negotiation, so as two of the theories prefer A the parliament will. Similarly in a choice between B and C the parliament will prefer B, and in a choice between C and A the parliament will prefer A.