Toggle comments on more on predicting agents - Less Wrong

0 Post author: sbenthall 08 November 2014 06:43AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (11)

You are viewing a single comment's thread.

Comment author: Toggle 08 November 2014 07:07:24PM 1 point [-]

Note that the second requirement is a doozy. Many dynamical nonlinear systems are in fact formally unpredictable past a certain threshold. In other words, it's quite common for 'a sufficient degree of accuracy' in modeling a system to simply not exist.

In the domain of human-created agents, your system will often be predictable, because the human that created it had a specific goal. But extending this to humans themselves may end up being problematic for the aforementioned reason- in that case, you're likely limited to probabilistic reasoning no matter how great the abilities of your predictor agent.

Comment author: ChristianKl 09 November 2014 11:35:49PM 0 points [-]

Adult humans are also very much human created. That's what the educational system is trying to do.

When you ask a child for the answer to '2+2' they might tell you 'green'. An adult is a lot more predictable because he has learned the 'right' answer.

Our best efforts to teach people to fit the shema sometimes fail but not always.

Comment author: Toggle 10 November 2014 03:15:36PM *  0 points [-]

True, and even much wider than the educational system, but I would probably rephrase to say that this makes human intelligence predictable within narrow domains. A math class strives to make students predictable when attempting to solve math problems, a legal system hopes to make humans predictable in the domain of violent conflict resolution, a religion hopes to make humans predictable in metaphysical inquiry, etc.

But human intelligence itself is fully general (in that we defined 'fully general' to mean 'like me'), so there's not really any form of training or education that can make, or attempts to make, human intelligence predictable across all domains.