The main suffering caused by the Spanish was through the unknowing introduction of European diseases, not because of their religion. I haven't studied the issue of the invasion of the Inca but I haven't heard it religiously motivated either.

From what I understand it would be more credible to blame said behavior on "capitalism" than "religion". What with the invading to take the land and natural resources (gold, for example).