Who is doing the type of work that you want to be doing right now, and what would it take to work with them? If you don't have an answer to that question, I suggest that you look into it.

If you go to grad school, focus on finding the right person, (your supervisor.) It's not as important which department, or program or school you go to.

I wouldn't base any major life decisions on the results of a standardized test. Even if it was measuring intelligence and aptitude well, (which it is not,) there are other things that are more important.

Giving up seems like a really bizarre thing to do, given what you've posted. What appeals to you about the idea of giving up? What would be the benefits of doing so?