KatjaGrace comments on Superintelligence 9: The orthogonality of intelligence and goals - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (78)
In practice do you expect a system's values to change with its intelligence?
I expect a system to face a trade off between self improvement and goal stability.
http://johncarlosbaez.wordpress.com/2013/12/26/logic-probability-and-reflection/