Stuart_Armstrong comments on Proper value learning through indifference - Less Wrong

16 Post author: Stuart_Armstrong 19 June 2014 09:39AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (50)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 19 June 2014 07:34:10PM 9 points [-]

I very much liked the analogy to Conservation of Expected Evidence---it strikes me as potentially deep; we want a system where EU and VoI are balanced such that it will never 'try' to end up with particular values, just as a Bayesian will never try to find evidence pointing in a particular direction.

I'm not sure who originally coined the phrase "Cake or Death problem" but I have a suspicion that it was me, and if so, I strongly suspect that I said it at a workshop and that I did it just to give the problem a 5-second handle that would work for a workshop. It's possible we should rename it before anyone publishes a paper.

Comment author: Stuart_Armstrong 20 June 2014 10:34:52AM *  2 points [-]