In particular you tend to ignore the point (or substance) of your partner's arguments which makes you look evasive or inattentive.

I think this is partly the by-product of a fundamental tension when conversing with someone in habit of making meaningless or incoherent statements. To directly address such "points", you basically have to ask the person to explain what they mean or rephrase their statement. If the explanation is junk, you're right back where you started, minus the time they spent explaining themselves. In the limit, indulging these non-terminating arguments equates to just letting them talk the entire time.