If it's thrown straight up, I see a simple argument that it will take longer to fall than to rise, but none showing the reverse. A driven golf ball would be a more ambiguous problem. The same argument as for the baseball applies, but there is the extra effect of the backspin operating in the opposite direction.