Kaj_Sotala comments on Tool ideology - Less Wrong

25 Post author: PhilGoetz 09 September 2011 10:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (66)

You are viewing a single comment's thread.

Comment author: Kaj_Sotala 10 September 2011 07:54:11AM 13 points [-]

I remember doing something similar. As kids, a friend and I were trying to figure out something computer-related - how to use some MS-DOS file compression software, I think. My friend suggested using some specific command, which I thought obviously couldn't work. He typed it in anyway, and behold! It did work. I blinked, and then it felt like a floodgate had opened in my mind and an explanation of why it did work came pouring in to my consciousness.

I've wondered if this might be a case of constraint propagation. Picture my mind as a network of beliefs, together with some algorithm trying to make sure that they are at least roughly consistent. A bunch of (incorrect) beliefs held with moderate confidence combine to suggest that the belief "this command would work" is incorrect with high confidence. But then I find out that the command does work, and the external evidence changes the value of that node. This forces an update to the beliefs that were connected to it, and the change propagates through the network and adjusts beliefs until I finally have high confidence in a theory that's completely different from what I believed in a minute ago.

Comment author: Matt_Simpson 10 September 2011 09:45:37PM 1 point [-]

After reading the first paragraph, I was going to comment on how this phenomenon is often useful, but you're second paragraph implicitly addresses that.