Here, have a book!
http://www-biba.inrialpes.fr/Jaynes/prob.html
IS this a good book to start with? I know it's the standard "Bayes" intro around here, but is it good for someone with, let's say, zero formal probability/statistics training?
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.