You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Vaniver comments on Q&A with experts on risks from AI #1 - Less Wrong Discussion

29 Post author: XiXiDu 08 January 2012 11:46AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (66)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vaniver 11 January 2012 05:10:26PM 1 point [-]

I've thought along somewhat similar lines of 'resource budget' before, and can't find anything obviously wrong with that argument. That is possibly because I haven't quite defined 'resources'.

The AI danger crowd seems happy to assume that the AI wants to maximize its available free energy, so I would assume they're similarly happy to assume the AI can measure its available free energy. I do agree that this is a potential sticking point, though, as it needs to price resources correctly, which may be vulnerable to tampering.