It makes a difference - I now have a good, high quality chair that cost over 250€ (not from my own pocket) and it's close to perfect - I can recline it to a comfortable position that is not possible with an "ordinary office" chair (I used to break them down on a regular basis). Despite being advertised as "super-resistant", this one already broke twice (covered by warranty). And when I had to sit on an "ordinary office" chair, I found out that I cannot work for more than an hour or two before I get serious pain in my back - this seems to be related to the monitor being beneath the eyes and the inability to recline - I (like to) have the monitor exactly at the eye level and looking slightly upwards.
Could you post a link to the kind of chair that you got?
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.