Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Mizue comments on Bayesianism for humans: prosaic priors - Less Wrong

22 Post author: BT_Uytya 02 September 2014 09:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (11)

You are viewing a single comment's thread.

Comment author: Mizue 03 September 2014 04:52:39AM 2 points [-]

Ooh, I get to comment.

A particular dull explanation is more likely than a particular exciting one. But it is possible that dull explanations, in general, are not more likely than exciting ones, in general, because there might be more of the exciting explanations even though each individual one is less likely.

(This is not typical--if you have cold symptoms, you probably have a cold and not an exotic disease--but it's possible.)

Comment author: ishi 03 September 2014 10:21:39AM 1 point [-]


  1. 2 sayings i like (relevant to the nerd issue) are 'I love humanity, i just hate people' and (for those of use who could be called 'elites' as distinct from the commoners ) 'I wouldn't me a member of any group that would me as a member' (Mark Twain). I'm not that convinced of the 'broken brain theory'. I tend to think in terms like 'frequency dependence' in biology or 'division of labor' in economics. Not everyone is the same, and there are reasons for that. (This is related also to the 'pigeonhole principle' and things like the existance of 'runts' in dog litters, various forms of hierarchies----in the real world, not everyone is in reaching distance of the same set of resources. Some don't get to sit in a warm place next to the fire, and so adapt to the cold. (And, very often, when occassionaly they get invited to be in the heat, since they have learned to live in, and even enjoy the cold, they are considered antisocial, rude and disturbed if they don't accept the invitation (eg 'you can take this job, or seat, and shove it'). Or if you invite people to consider coming into the cold, that will be considered insanity.

    (This goes for other things too---if you decide religion is very narrow, boring, intolerant etc. but then one day the confgregation decides that, since they are losing members and tithes, they will 'lighten up' and invite you back (but again on their slightly revised terms---eg they won't preach that you are going to hell, but will still tell you to shut up why they preach to you the truth which you know nothing about). If you decide your peer group who does nothing but bar hop is boring and find new activities, when they see you again and say 'hey come on, lets party' they will say 'you've really changed and are no fun anymore, unlike us party animals'. Darwin was probably a nerd and didnt attend church (or half heartedly, mostly for show). Einstein wasn't a big zionist type studying the torah and waiting to return to the promised land, but was interested in larger parts of the space of possibilities. He also wasn't much of a family man it seems, preferring to do stuff like EPR rather than like mowing the lawn, going to July 4 fireworks etc. (He did sign a letter written to Joe McCarthy (congressman) supporting Paul Robeson who was being accused of being a communist, and he helped get Godel citizenship, so that may have some relation to being a patriot).

  2. To me the 'dull prior' is similar to the 'maximum entropy' postulate in statistical mechanics (which Jaynes i think identified with bayesianism). There are (as a caveat) in my view many ways of applying this postulate, so there can be a hierarchy of 'dullness' ---its what you call dull, or what your information is. (This is why i personally don't really consider bayesianism distinct from frequentism, any more than i consider so called 'linear' sciences as distinct from 'nonlinear' ones. (The former just comes usually by truncating your equation, or changing coordinates,, or aggregating). This is also why I am highly skeptical of many applications of maximum entropy especially in fields like economics or other social sciences. The formalism is so general that you can find any result you want, or fit any distribution (with your prior 'principle of impotence'---equal a priori probability ---like 'overfitting' (eg Norbert Weiner on elephants) .). EG just because someone fits the description, doesn't mean they did the crime though this sort of 'prior' is often used since it seems to work (eg you solve the crime, case closed, god said it, i believe it and that is all there is to it, qed.).

Comment author: [deleted] 03 September 2014 10:27:18PM 1 point [-]

Einstein wasn't a big zionist type studying the torah and waiting to return to the promised land,

Just some historical nitpicking, but "Zionist" is a political descriptor, not a religious one. Particularly in Einstein's time, the word would have meant something more like "socialist commune member" than "observantly religious person".

In fact, most usages of the term "Zionist" today are wrong, since the word is used more often by its enemies than by its supporters.

Comment author: ishi 05 September 2014 05:11:41PM 0 points [-]

I agree with you on this---its a political term nowadays , and im in DC so i fairly commonly come across all the uses (and i even have distant cousins in Israel, my closer ones came through ellis island from russia around 1910, have some distant ones who died in the holocaust, etc.). but technically i'm goy through genetics and/or descent. (other half of my family were essentially expelled from britain because they were a dissident protestant sect---the brethren, related in a way to the mennonites. they werent involved in salem witch trials, nor indigenous genocide, though did get their 40 acre farm in north dakota---before fracking ). (I gather Herzl (sic) maybe wrote early ideas on zionism for various reasons (religion, political persecution---russia had pogroms (see 'fiddler on a roof' movie i think )). Einstein does have an essay 'why i am a socialist' (one can also consider bertrand russel's 'why i am not a christian' (he was, like me, agnostic) . kibbutz idea. Sorin Solomon of Weiszmann Inst and NewInstitute for Economic thinking is one prof there (writes on statistical mechanics of income distribution); i think he was in Peace Now. Einstein was on first board of Hebrew U.