Testosterone has its downsides.
Messes with cholestrol levels something shocking. Makes you stinky. Causes acne. Is converted to DHT leading to male pattern baldness and
You actively avoid lifting weights so as to reduce your testosterone levels? That's not something I've heard before.
I don't lift. I used to. If I were to start lifting again it'd be a relevant consideration. Most people could probably use more testosterone, but I think my optimal testosterone level is low. Years ago someone told me intellligence was correlated with high testosterone at birth but low testosterone as an adult. Makes sense to me.
An interesting blog post by Razib Khan, who many here probably know from his Gene Expression blog, the old gnxp site or perhaps from his BHTV debate with Eliezer.
I recommend following the link and reading the rest of it there, not only does interestingness continue, the comment section there is usually worth reading since he vigorously moderates it.