I would agree that this is true, but I'd caution against thinking of even government bonds as a textbook "risk-free" investment.

Correct consideration, I personally know a greek guy who bought decennial bonds from his own country five years before the collapse and got heavily screwed. This should be a more remote possibilitie for e.g US bonds, and it's kind of a "second order consideration" for someone who is just approaching the idea of investing money. I'm not sure of the taxing policies in the US, so I can't really help, but the priciple it's true. One of the reasons why I was suggesting Insurance Companies in another post is that they usually are subjected to a different (lighter) tax regime.