Allowable values of functions are whatever you want.
They are limited by the scope of whatever theory you are working in.
Yes, and of course which theory will be appropriate is going to be determined by the actual physics. My point is just that your statement that "pure math does not have infinities" and physicists "added them in" is wrong (even ignoring historical inaccuracies).
[edit: sorry, the formatting of links and italics in this is all screwy. I've tried editing both the rich-text and the HTML and either way it looks ok while i'm editing it but the formatted terms either come out with no surrounding spaces or two surrounding spaces]
In the latest Rationality Quotes thread, CronoDAS quoted Paul Graham: