Vladimir_Nesov comments on Motivating Optimization Processes - Less Wrong

5 Post author: paulfchristiano 22 December 2010 11:36PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vladimir_Nesov 23 December 2010 03:32:12PM 1 point [-]

To talk about "stable under self-modification", you need a notion of what it is that needs to be stable, the kind of data that specifies a decision problem. Once we have that notion, it could turn out to be relatively straightforward to extract its instance from human minds (but probably not). On the other hand, while we don't have that notion, there is little point in attacking the human decision problem extraction problem.