This is related to making a strong learner (really accurate) out of weak learners (barely better than majority). It is actually somewhat non-obvious this should even be possible.
The famous example here is boosting, and in particular "AdaBoost." The reason boosting et al. work well is actually kind of interesting and I think still not entirely understood.
I didn't really get Vaniver's explanation below, there are margin methods that draw the line in a sensible way that have nothing to do with weak learners at all.
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should be posted in Discussion, and not Main.
4. Open Threads should start on Monday, and end on Sunday.