Tentatively: Look for what "and therefore" you've got associated with the feeling. Possibilities that come to my mind-- and therefore people are frightening, or and therefore I should be angry at them all the time, or and therefore I should just hide, or and therefore I shouldn't be seeing this.

In any case, if you've got an "and therefore" and you make it conscious, you might be able to think better about the feeling.