Given this information, it may very well be that drawing isn't worth the time-cost to you. It may also be that gesture drawing doesn't work as effectively for you. There are some other hacks you can try - have you done the exercises summarized in this article at some point?

If not, I'd definitely give them a try - they won't take more than a 2-3 hours and you can do them on your own. It's possible you're simply an outlier (frustrating as that may be) but I expect you'll see at least some improvement.

Can you articulate the ways in which you have a hard time? Do you think it's more about inability to observe, hand-eye coordination or something else? Can you trace over a drawing effectively?