I don't think I experience this problem too much. When I have an idea that seems important, I tend to revisit periodically, so I will continue writing. If I have an idea which doesn't seem that important, but I'm interested in, I usually drop it. Of course, maybe this is purely a selection effect.

I am a person who used to hate writing and now finds it mildly fun, so perhaps David_Gerard's point applies.