I am pretty sure this is not the main issue, nor is being "weird." But it is the fact that you want to work unusually few hours. That shows, as Viliam said, that you are less interested in working than on average. Employers would prefer not to have people unusually disinterested in working. The guy paying 50% of the money for 80% of the time was probably being reasonable, in terms of the expected value of a worker disinterested in working.

I agree that if everyone worked less, the supposed problem would go away. But that could only happen if everyone became less interested in working. I note that the average work week used to be much longer than 40 hours. So the fact that it has gone down somewhat, but not more, shows that people are not infinitely interested in working, but also not totally disinterested.

Tyler Cowen, talking about why the standard work week hasn't gone down to even less than 40 hours, says it is because people "like money, and like working," but that the reason they like working is that they don't like their personal lives that much. If he is right, then future improvements to personal life, as well as to the ability of less money to buy things, might end up leading to shorter work weeks. But it does not look like there is any short term solution that works well for people who are simply less interested in working than on average.