David_Gerard comments on Reply to Holden on 'Tool AI' - Less Wrong

94 Post author: Eliezer_Yudkowsky 12 June 2012 06:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (348)
Tags: holden givewell siai fai

Comments (348)

You are viewing a single comment's thread.

Comment author: David_Gerard 08 August 2012 09:01:32AM 5 points [-]

Marcus Hutter is a rare exception who specified his AGI in such unambiguous mathematical terms that he actually succeeded at realizing, after some discussion with SIAI personnel, that AIXI would kill off its users and seize control of its reward button.

A couple of people have enquired with Hutter and he has denied saying this. So it appears a citation is needed.

Comment author: Eliezer_Yudkowsky 08 August 2012 06:46:07PM 8 points [-]

I'll try to get the results in writing the next time we have a discussion. Human memory is a fragile thing under the best of circumstances.

Comment author: HBDfan 09 August 2012 08:08:09AM *  0 points [-]

[delete]

Comment author: timtyler 08 August 2012 10:38:10AM *  0 points [-]

AIXI is uncomputable - and so is impossible to construct. Hutter is well aware of this - so it seems doubtful that he would make such a dubious claim about its real-world behaviour.

Powered by Reddit Powered by Reddit