tgb comments on Rationality Quotes May 2012 - Less Wrong

6 Post author: OpenThreadGuy 01 May 2012 11:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (696)

You are viewing a single comment's thread. Show more comments above.

Comment author: nykos 03 May 2012 12:21:41PM *  4 points [-]

More quotes by Mencius Moldbug:

When they say things like "in cognitive science, Bayesian reasoner is the technically precise codeword that we use to mean rational mind," they really do mean it. Move over, Aristotle!

Of course, in Catholicism, Catholic is the technically precise codeword that they use to mean rational mind. I am not a Catholic or even a Christian, but frankly, I think that if I had to vote for a dictator of the world and the only information I had was whether the candidate was an orthodox Bayesian or an orthodox Catholic, I'd go with the latter.

The only problem is that this little formula is not a complete, drop-in replacement for your brain. If a reservationist is skeptical of anything on God's green earth, it's people who want to replace his (or her) brain with a formula.

To make this more concrete, let's look at how fragile Bayesian inference is in the presence of an attacker who's filtering our event stream. By throwing off P(B), any undetected pattern of correlation can completely foul the whole system. If the attacker, whenever he pulls a red ball out of the urn, puts it back and keeps pulling until he gets a blue ball, the Bayesian "rational mind" will conclude that the urn is entirely full of blue balls. And Bayesian inference certainly does not offer any suggestion that you should look at who's pulling balls out of the urn and see what he has up his sleeves. Once again, the problem is not that Bayesianism is untrue. The problem is that the human brain has a very limited capacity for analytic reasoning to begin with.

They are all from the article A Reservationist Epistemology

Comment author: tgb 03 May 2012 01:00:10PM 11 points [-]

If the attacker, whenever he pulls a red ball out of the urn, puts it back and keeps pulling until he gets a blue ball, the Bayesian "rational mind" will conclude that the urn is entirely full of blue balls.

Surely the actual Bayesian rational mind's conclusion is that the attacker will (probably) always show a blue ball, nothing to do with the urn at all.

Comment author: Viliam_Bur 04 May 2012 08:19:12AM 9 points [-]

Solomonoff prior gives nonzero probability to the attacker deceiving us. But humans are not very good at operating with such probabilities precisely.