Both are important, some more so for some people than others. I and members of my family are lucky enough to lose weight rapidly with food restriction and exercise; many other people not so much. WHAT is eaten rather than its sheer energy content can also make a big difference.

Why can't anything in biology ever be simple...