So8res comments on MIRI Research Guide - Less Wrong

54 Post author: So8res 07 November 2014 07:11PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (63)

You are viewing a single comment's thread. Show more comments above.

Comment author: So8res 07 November 2014 11:15:08PM *  4 points [-]

Thanks! FWIW, I don't strongly expect that we'll have to abandon VNM at this point, but I do still have a lot of uncertainty in the area.

I will be much more willing to discard objection 1 after resolving my confusion surrounding Pascal muggings, and I'll be much more willing to discard objection 2 once I have a formalization of "corrigibility." The fact that I still have some related confusions, combined with the fact that (in my experience) mathematical insights often reveal hidden assumptions in things I thought were watertight, combined with a dash of outside view, leads me to decently high credence (~15%, with high anticipated variance) that VNM won't cut it.

Comment author: [deleted] 20 December 2014 05:34:41PM 0 points [-]

What's the definition of preferences used in boundedly-rational agent research?