You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

XiXiDu comments on [draft] Concepts are Difficult, and Unfriendliness is the Default: A Scary Idea Summary - Less Wrong Discussion

7 Post author: Kaj_Sotala 31 March 2012 10:07AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (39)

Comments (39)

You are viewing a single comment's thread. Show more comments above.

Comment author: XiXiDu 31 March 2012 02:43:05PM *  1 point [-]

Could you point out the main things that give the impression that I'm presuming utility function -based decision making?

I am not sure what other AGI designs exist, other than utility function based decision makers, where it would make sense to talk about "friendly" and "unfriendly" goal architectures. If we're talking about behavior executors or AGI designs with malleable goals, then we're talking about hardcoded tools in the former case and unpredictable systems in the latter case, no?

Powered by Reddit Powered by Reddit