You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

private_messaging comments on Imposing FAI - Less Wrong Discussion

3 Post author: asparisi 17 May 2012 09:24PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (8)

You are viewing a single comment's thread.

Comment author: private_messaging 17 May 2012 11:19:43PM *  0 points [-]

Well the idea, I gather, is that the FAI will enforce that.

In practice though, it has not even been explicitly listed as requirement for powerful AGI (let alone articulated why), that the AGI has to, on same hardware, outperform - at the task of designing better computers for example - the non-general-intelligent tools which work by combination of iteration with analytic methods and hill climbing (and perhaps better approaches taken from the AGI effort), and whose problem and solution spaces are well defined. (those can think outside the box in human terms, as them search bigger spaces than humans, but within the permissible model and solution space, i.e. 'killing humans helps make better microchip' sort of statements are not even processable in the system which is designed for engineering materials at microscale)