[math-fun] The difficulty of integration vs. the ease of differentiation

Why is it usually so easy to differentiate a function defined by an exact formula, but so much more difficult to integrate? If this question can be made rigorous, how might that be done? (And if so, what is the rigorous answer, or at least a method of approaching it?) —Dan