I've been reading a book similar to what you have in mind I think. It's "Mathematics: From the birth of numbers" (http://www.amazon.com/Mathematics-Birth-Numbers-Jan-Gullberg/dp/039304002X). It starts very basic but covers all sorts of advanced topics. It's designed for someone with no higher math learning. I'm about 1/4 of the way through it and so far very impressed.
I've been reading a book similar to what you have in mind I think. It's "Mathematics: From the birth of numbers" (http://www.amazon.com/Mathematics-Birth-Numbers-Jan-Gullberg/dp/039304002X). It starts very basic but covers all sorts of advanced topics. It's designed for someone with no higher math learning. I'm about 1/4 of the way through it and so far very impressed.