In addition to what others have said, I think it's important to distinguish between killing and suffering. The real problem here isn't the killing of animals; it's the suffering they undergo before they're killed. I don't know what it's like for those animals that die as a result of agriculture, but suppose they generally have painful deaths that last for several hours. On the other hand, animals on factory farms suffer greatly for a much longer period of time.