toward the side away from your nose in your field of vision

So the optic nerve blind spot wouldn't really be noticeable when stargazing with both eyes. That's what I was expecting or vaguely recalling.