The difference between Math and Statistics
"Statistics is the science of collecting and interpreting data. Dealing with uncertainty is a cornerstone of the the statistical method, and distinguishes it from the mathematical method. The mathematical method is deductive: its concern is the logical derivation of consequences from explicitly stated assumptions. The Statistical method is inferential: given empirical evidence in the form of data, its goal is to ask what underlying natural laws could have generated the data; and it is the imprecision or uncertainty in the data which makes the inferential process fundamentally different from mathematical deduction."
- from "Statistics and Scientific Method"