I don't associate red with smoothness, or silk with any of those emotional qualities.
Are you sure about that? Your emotions don't ask you for permission before they make associations.
I can't tell if this is wordplay based on the ambiguity in the quoted sentence (in which case, I like the joke :) ) or if you're serious. If you're serious, then yes, I'm sure: while emotions may not ask me for permission, I'm aware of what they're associated with.
This is our monthly thread for collecting these little gems and pearls of wisdom, rationality-related quotes you've seen recently, or had stored in your quotesfile for ages, and which might be handy to link to in one of our discussions.