That's true in calculus, and probably a lot of other applied mathematics contexts where rigor tends to get swept under the rug, but it's not completely fair since there are versions of "infinity" that are defined and used rigorously. (The transfinite ordinals and cardinals mentioned in the Stack Overflow article are the example I'm familiar with.)