Consider the typical American diet and what they snack on and compare it to eating nuts; I'd be amazed if it didn't tend to make it more difficult for those people to get the same amount of calories. I wonder if you've had the kinds of nuts paleo dieters eat. They're unsalted and uncooked walnuts, almonds, or pecans (typically almonds) -- not exactly a superstimulus.

And remember, you need 24 almonds to get ~128 calories.