I'll give you that nutrition/exercise is very high on the list of things to do to optimize memory, but I'm skeptical that it's more important than mnemonics.

Personally, movement from fairly wretched nutrition/exercise to Lifestyle Interventions to Improve Longevity/Optimal Exercise-compliant nutrition/exercise has helped lots and lots, but (for the limited cases it applies), Method of Loci helped more.