It seems like we ought to only purchase free time when it comes cheaper than a certain figure, $x/hr, and ought to only work if we can sell our free time for more than $x/hr

Even for a specific person at a specific point in their life, x isn't constant. Some days I might have more time than things I need to do, others less. Being able to easily convert between money and time as days required would be really handy.