Limited access to limited resources is far more typical, and life is not so leisurelly when you spend every hour of > daylight working to procure food that still isn't enough to provide for you and your family. That is also the state of > nature and was a situation that a great many people have found themselves in for the brief time that they managed to survive it.
That...actually doesn't represent the human condition for most of our ancestral history, nor the current state of surviving forager peoples for the most part.
Resources are limited, but you only need about 15 hours of work a week per hunter-gatherer individual devoted to food-producing activities. Overdo that and you may well tax your ecosystem past carrying capacity. This is why foragers wander a migratory circuit (although they tend to keep to a known, fixed route) or live in areas where there's sufficient ecological abundance to allowed for a sedentary lifestyle while still using hunter-gatherer strategies. It's also why they tended to have small populations. Scarcity was something that could happen, but that's why people developed food preservation technologies and techniques that you can assemble with nothing more than accumulated oral tradition and some common sense. Tie a haunch of meat down to some stones and toss it down to the bottom of a cold lake. That meat will keep for months, longer if the lake freezes over. It'll be gamy as hell, but you won't starve -- and this is a pretty typical solution in the toolkit of prehistoric humans from Northern regions. Drying, salting (sometimes using methods that would squick you -- one branch of my ancestors comes from a culture that used to preserve acorns by, kid you not, burying them in a corner of the home and urinating over the cache), chemical preservation, favoring foods that store long-term well in the first place, fermentation, and a flexible diet are all standard knowledge.
In the American Southwest (a hot, harsh, dry and ecologically-poor climate), Pueblo people and many others used to rely on the seasonal abundance of Mormon Crickets for protein. You can gather eighteen pounds of them an hour when they pass through, basically just by walking around and picking up bugs. The nutritional profile beats the hell out of any mammal meat, and they can be preserved like anything else. Think about that for a second -- one person, in one hour, can provide enough of these bugs to feed an entire village for a day, or their own household for weeks (and that's without preservation). It's not desperation; it's a sound food-gathering strategy, and a lot more palatable when you don't come from a culture used to think of insects as a culinary taboo.
Starving to death is more of an issue for low-tech pastoralists and agriculturalists -- people who use just a small fraction of the available edible resources to support populations that wouldn't be able to forage on the available resources. The relationship of effiort to output for them is linear; work your farm harder, get more food in proportion -- and you need to run a surplus every year in most cases because there is non-negotiable downtime during which it's going to be hard to switch to another food source (and even if you do, you'll be competing with your neighbors for it).
In my own case, I've taken part in of a family of five supplying themselves with only a few culturally-specific dietary staples (powdered milk, spices, flour, rice, things that we could easily have done without had they not been available) doing most of their food-production by just going out and getting it somewhere within a mile of home. Clams. squid and oysters were for storing (done with a freezer or by canning with water and salt) and cooking up into dishes we could eat for the rest of the month; small fish were gathered day-by-day, large fish stored (one salmon or sturgeon can feed five people for over a month when you have a freezer), crabs and similar gathered on a case-by-case basis. I personally wasn't fond of frog legs, but a nearby pond kept up with a whole lot of demand for frogs in my family and others. We never bothered with anything like deer or bird hunting, but we'd gather berries, tree fruits (apple, plum, pear) and mushrooms, grow garden veggies and basically just keep ourselves supplied.
I'm not saying everyone on Earth could switch back today -- heck no. A whole lot of people would starve to death after destroying the ecosystems they need. But my ancestors lived in that place for thousands of years and starving to death was not a common experience among them, because they weren't used to the population densities that only come with intensive agriculture. And there are people descended from foragers of even more remote and desolate climes -- some of them STILL living that way -- who can say the same thing.
Then what limited the growth of forager peoples so substantially? There had to be a mechanism to prevent them from exceeding their region's carrying capacity. If a tribe of 50 people grew at a rate of 1% a year for 2000 years there would 24 billion people in it. Clearly that didn't happen; in fact there have been massive die-offs from starvation due to cyclical climate change, or to resource warfare (sometimes fought to extinction) between neighboring tribes.
From Mike Darwn's Chronopause, an essay titled "Would You Like Another Plate of This?", discussing people's attitudes to life:
Conclusion, graphs, and references in article. As usual, I recommend reading Chronopause.com as Darwin has many good articles; to quickly link a few: