Following up on the idea of breaking narrative logic, might there not really be a Big Bad at all. Like, Voldemort has sobered up over the years and really just wants to be immortal. He'll go to great lengths to get there, but doesn't plan to destroy the world or anything. Just an idea.