Wei_Dai comments on Our Phyg Is Not Exclusive Enough - Less Wrong

25 [deleted] 14 April 2012 09:08PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (513)

You are viewing a single comment's thread. Show more comments above.

Comment author: Wei_Dai 15 April 2012 07:14:11PM *  3 points [-]

Actually, it's quite surprising that nobody who (publically) cares about AI risk has, to the best of my knowledge, even tried to extend the AIXI framework to incorporate some notion of friendliness...

UDT can be seen as just this. It was partly inspired/influenced by AIXI anyway, if not exactly an extension of it. Edit: It doesn't incorporate a notion of friendliness yet, but is structured so that unlike AIXI, at least in principle such a notion could be incorporated. See the last paragraph of Towards a New Decision Theory for some idea of how to do this.