Interesting, this is exactly how I felt a week ago. I am the product of western culture, after all. Anyway, if no arguments are provided I can explain the reasoning since I'm pretty familiar with it. I also know exactly where the error in reasoning was.
The error is this: the reasoning assumes that humans desires are designed in a way that makes sense with respect to the way reality is. In other words, that we're not inherently deluded or mislead by our basic nature in some (subjectively) unacceptable way. However, the unexamined premise behind this is that we were designed with some care. With the other point of view -- that we are designed by mechanisms with no in-borne mechanism concerned for our well-being -- it is amazing that experience isn't actually more insufferable than it is. Well, I realize that perhaps it is already as insufferable as it can be without more negatively affecting fitness.
But imagine, we could have accidentally evolved a neurological module that experiences excruciating pain constantly, but is unable to engage with behavior in a way to effect selection, and is unable to tell us about itself. Or it is likely, given the size of mind-space, that there are other minds experiencing intense suffering without the ability to seek reprieve in non-existence. How theism works explains that while theists are making stuff up, they can make up everything to be as good as they wish. On the other hand, without a God to keep things in check, there is no limit on how horrible reality can be.
The error is this: the reasoning assumes that humans desires are designed in a way that makes sense with respect to the way reality is. In other words, that we're not inherently deluded or mislead by our basic nature in some (subjectively) unacceptable way.
Interestingly, this is the exact opposite of Zen, in which it's considered a premise that we are inherently deluded and misled by our basic nature... and in large part due to our need to label things. As in How An Algorithm Feels From Inside, Zen attempts to point out that our basic nature is delusi...
Sometime ago Jonii wrote:
When I'm hungry I eat, but then I don't go on eating some more just to maximize a function. Eating isn't something I want a lot of. Likewise I don't want a ton of survival, just a bounded amount every day. Let's define a goal as big if you don't get full: every increment of effort/achievement is valuable, like paperclips to Clippy. Now do we have any big goals? Which ones?
Save the world. A great goal if you see a possible angle of attack, which I don't. The SIAI folks are more optimistic, but if they see a chink in the wall, they're yet to reveal it.
Help those who suffer. Morally upright but tricky to execute: James Shikwati, Dambisa Moyo and Kevin Myers show that even something as clear-cut as aid to Africa can be viewed as immoral. Still a good goal for anyone, though.
Procreate. This sounds fun! Fortunately, the same source that gave us this goal also gave us the means to achieve it, and intelligence is not among them. :-) And honestly, what sense in making 20 kids just to play the good-soldier routine for your genes? There's no unique "you gene" anyway, in several generations your descendants will be like everyone else's. Yeah, kids are fun, I'd like two or three.
Follow your muse. Music, comedy, videogame design, whatever. No limit to achievement! A lot of this is about signaling: would you still bother if all your successes were attributed to someone else's genetic talent? But even apart from the signaling angle, there's still the worrying feeling that entertainment is ultimately useless, like humanity-scale wireheading, not an actual goal for us to reach.
Accumulate power, money or experiences. What for? I never understood that.
Advance science. As Erik Naggum put it:
Don't know, but I'm pretty content with my life lately. Should I have a big goal at all? How about you?