You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

shminux comments on Superintelligence 16: Tool AIs - Less Wrong Discussion

7 Post author: KatjaGrace 30 December 2014 02:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (36)

You are viewing a single comment's thread.

Comment author: shminux 30 December 2014 03:29:16AM 2 points [-]

I have trouble understanding how one can tell an agent from a non-agent without having access to its "source code", or at least its goals.

Comment author: TheAncientGeek 30 December 2014 02:15:27PM 1 point [-]

Goals are likely to be emergent in many systems, such as neural nets. OTOH, trainable neural would be corrigible.