You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

OrphanWilde comments on Perceptual Entropy and Frozen Estimates - Less Wrong Discussion

10 Post author: Davidmanheim 03 June 2015 07:27PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (20)

You are viewing a single comment's thread.

Comment author: OrphanWilde 03 June 2015 08:42:00PM 2 points [-]

It sounds like you're talking about informational entropy, and the model you're describing sounds -very- similar to a neural net, which uses something like entropy to arrive at conclusions. Have you investigated either of these topics, and/or am I misreading you?

Comment author: Davidmanheim 03 June 2015 09:35:44PM 1 point [-]

I am talking about informational entropy, but using the analogy to pressure as a intuition pump. This applies whether we are using neutral nets or other PGMs. In fact, I was thinking of causal BNs as ideal approximations of human rationality, and noting the additional fact that there seems to be some cost to maintaining uncertainty that seems to fit the earlier analogy. (Sorry if I'm unclear - I will reread and try to clarify when I'm not on my phone.)