Morendil comments on Open Thread: November 2009 - Less Wrong

3 [deleted] 02 November 2009 01:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (539)

You are viewing a single comment's thread.

Comment author: Morendil 04 November 2009 06:46:05PM 1 point [-]

I'm working through Jaynes' /Probability Theory/ (the online version). My math has apparently gotten a bit rusty and I'm getting stuck on exercise 3.2, "probability of a full set" (Google that exact phrase for the pdf). I'd appreciate if anyone who's been through it before, or finds this stuff easy, would drop a tiny hint, rot13'd if necessary.

V'ir pbafvqrerq jbexvat bhg gur cebonovyvgl bs "abg trggvat n shyy frg", ohg gung qbrfa'g frrz gb yrnq naljurer.

V unir jbexrq bhg gung jura z=x (gur ahzore bs qenjf = gur ahzore bs pbybef) gur shyy frg cebonovyvgl vf tvira ol gur trarenyvmrq ulcretrbzrgevp qvfgevohgvba jvgu nyy e'f=1. V'z gelvat gb svther bhg ubj gung cebonovyvgl vapernfrf nf lbh nqq zber qenjf. Vg frrzf gb zr gung ol rkpunatrnovyvgl, gur cebonovyvgl bs n shyy frg jvgu x+1 qenjf vf gur fnzr nf gur cebonovyvgl bs n shyy frg jvgu x, naq bar rkgen qenj juvpu pna or nal pbybe: SF(P1+P2+..+Px) juvpu vf SF.P1+SF.P2+..+SF.Px, juvpu ner zhghnyyl rkpyhfvir gurersber nqq hc.

Nz V ba gur evtug genpx ng nyy ?

How many people here would be interested in forming a virtual book study group, to work through Jaynes ? Some programmer colleagues of mine have done that for SICP and it turns out to be a nice way to study. Strength in numbers and all that.

Comment author: rhollerith_dot_com 04 November 2009 09:03:42PM *  1 point [-]

How many people here would be interested in forming a virtual book study group, to work through Jaynes ?

There already exists (an extremely low-traffic) mailing list with that mission: etjaynesstudy@yahoogroups.com

Note that the objection that an existing mailing list would be populated by people who have not been exposed to Eliezer's writings on rationality does not apply here because (1) the current population consists of only a handful of people and (2) what I have seen of the current population over the last 3 or 4 years is that it consists mostly of a few people posting (relevant) faculty positions and conference announcements and experts in Bayesian statistics.

Comment author: Morendil 04 November 2009 09:59:54PM 0 points [-]

Thanks for the info !

Comment author: mtraven 04 November 2009 07:41:34PM 0 points [-]

How many people here would be interested in forming a virtual book study group, to work through Jaynes ?

Yes! I've been wanting a virtual place to help me learn probabilistic reasoning in general; a group focued on Jaynes would be a good start.

Comment author: Morendil 15 November 2009 12:32:18PM 0 points [-]

So far it seems to be only the two of us, which seems rather surprising. In probabilistic terms, I was assigning a significant probability to receiving N>>1 favorable replies to the suggestion above.

I'm not sure yet how I should update on the observation of only one taker. One hypothesis is that the Open Thread isn't an effective way to float such suggestions, so I could consider a top-level post instead. Another is that all LWers are much more advanced than we are and consider Jaynes' book elementary. What other hypotheses might I be missing ?

Comment author: gwern 16 November 2009 12:29:31AM 1 point [-]

There're more than that, over time anyway: http://tech.groups.yahoo.com/group/etjaynesstudy/

(Personally, my problem is that Jaynes is difficult, my calculus weak, and I have no particular application to study using it. It's like programming - you learn best trying to solve problems, not just trying to memorize what map is or whatever. Even though I have the book, I haven't gone past chapter 2.)

Comment author: RobinZ 15 November 2009 04:21:22PM *  1 point [-]

That within the set of those interested in studying Jaynes the set of those interested in studying Jaynes through a virtual book study group is small. Some people find virtual study groups ineffective. That'd be my reason for not responding.

Comment author: Morendil 15 November 2009 06:25:42PM 0 points [-]

OK. Who wants to study Jaynes - at all ?

If you find virtual study groups ineffective, then - ineffective compared to what ?

To study some material, two things are quite useful: access to the material, and access to someone who can help you over difficult spots in the material. Even if you intend to study alone, having the latter as an option can reasonably be expected to increase your chances. (Modulo the objection "I'll expect too much help from outside and that'll degrade my learning", which I could understand.)

In this case Jaynes' book is a free PDF; on the other hand, the LW readership probably doesn't have formal access to a formal teacher for this material, I'd expect occasions to meet others interested in it IRL are fairly rare.

Given all this I'd still expect more of a response than has been the case so far.

Comment author: arundelo 15 November 2009 07:45:04PM 1 point [-]

OK. Who wants to study Jaynes - at all ?

I'd like to someday, but unfortunately not now. :-/

Comment author: RobinZ 15 November 2009 11:59:36PM 0 points [-]

I'd like to study Jaynes, although it's not on the top of my priority list - and I'm under the impression that the free PDF has been taken down at the moment.

If you find virtual study groups ineffective, then - ineffective compared to what ?

Wasn't making a comparison, actually - just saying that joining a group of people online to study something hasn't actually led to me studying in the past. Ineffective compared to taking a course, I suppose.

Comment author: gwern 16 November 2009 12:27:01AM 1 point [-]

The PDF may've been taken down by whomever was hosting it, but it's easily found: http://omega.albany.edu:8008/JaynesBook.html for example, to say nothing of all the download sites or P2P sources you could use.

Comment author: wedrifid 17 November 2009 08:44:43AM 0 points [-]

So far it seems to be only the two of us, which seems rather surprising. In probabilistic terms, I was assigning a significant probability to receiving N>>1 favorable replies to the suggestion above.

I am quite interested but I know from experience that I study would seem too much like work. I would probably stop doing it until I actually needed to expand my skills for some purpose practical or otherwise.

That being said, I would quite probably follow along with such a group and almost certainly get sucked into answering questions people posed. That changes it from 'homework' to 'curious problem someone put up and I can't resist solving'.

Comment author: mtraven 17 November 2009 08:35:37AM 0 points [-]

Yes, probably it deserves a top-level post, or going outside of this community and advertsing more widely.

Comment author: Vladimir_Golovin 15 November 2009 01:03:04PM 0 points [-]

So far it seems to be only the two of us, which seems rather surprising.

Perhaps there are more, but they just don't want to signal that they are newbies at probabilistic reasoning.

Comment author: Yorick_Newsome 26 November 2009 08:15:15AM 1 point [-]

I may be the only one of my kind here, but I know absolutely nothing about probabilistic reasoning (I am envious of all you Bayesians and assume you're right about everything. Down with the frequentists!); thus, I think Jaynes would be too far over my head. Maybe there's a dichotomy between philosophy / psychology / highschool Lesswrongers and computer science / physics / math Lesswrongers that make the group of people at Jaynes-level a small group.

Comment author: AdeleneDawner 26 November 2009 12:42:40PM 0 points [-]

You're not the only one. I'm not bad at math and logic, but very rusty, and almost completely uneducated when it comes to probabilities. (Oddly enough, the junior high school I went to did offer a probabilities course - to the students who were in the track below me. We who tested highest were given trigonometry a year earlier, instead.)

You might be right about the divide, too - I'm more in the former category than the latter, for all that I'm a programmer, and it doesn't seem like I'd have much opportunity to use the math even if I took the time to learn it, so there's very little motivation for me to do so.