If you believe that her attractiveness is a property of her, rather than a property of you, then you have a different problem.

Or you could think of it as both. You could say 'she is attractive_me' or define attractive(attracted person, attracting person) as being true/false, and then say that attractive(me, her) == true. Agreed, you can't have 'she is attractive', with 'attractive' denoting possession of a particular set of traits that remains constant regardless of whoever's using the word.

But, yeah, I'm pretty sure that I agree with what you're saying in general.

ETA: "whoever's"