I used to not listen to music for similar reasons, yet I played piano regularly. I also was confused by it, especially the lyrics---I couldn't understand what people were saying.

Eventually, peer pressure got me and I started listening to music, usually one cd over and over. Eventually I came to like it and became more comfortable with it as background, in a very similar way to wearing a watch or clothes different from my usual is extraordinarily uncomfortable, but after a week it becomes the new normal.