I think that you must differ from the average person in some way that makes it not enjoyable for you. Perhaps you are more sensitive to certain sounds and find them unpleasant. Perhaps you weren't exposed to music at a very young age. Your brain might be "wired" differently than average.
This is a thread where people can ask questions that they would ordinarily feel embarrassed for not knowing the answer to. The previous "stupid" questions thread went to over 800 comments in two and a half weeks, so I think it's time for a new one.