We establish quantitative results for the statistical behaviour of infinite systems. We consider two kinds of infinite system: i) a conservative dynamical system (f, X, µ) preserving a σ-finite measure µ such that µ(X) = ∞; ii) the case where µ is a probability measure but we consider the statistical behaviour of an observable φ : X → [0, ∞) which is non-integrable: φ dµ = ∞. In the first part of this work we study the behaviour of Birkhoff sums of systems of the kind ii). For certain weakly chaotic systems, we show that these sums can be strongly oscillating. However, if the system has superpolynomial decay of correlations or has a Markov structure, then we show this oscillation cannot happen. In this case we prove a general relation between the behaviour of φ, the local dimension of µ, and the scaling rate of the growth of Birkhoff sums of φ as time tends to infinity. We then establish several important consequences which apply to infinite systems of the kind i). This includes showing anomalous scalings in extreme event limit laws, or entrance time statistics. We apply our findings to non-uniformly hyperbolic systems preserving an infinite measure, establishing anomalous scalings for the power law behaviour of entrance times (also known as logarithm laws), dynamical Borel-Cantelli lemmas, almost sure growth rates of extremes, and dynamical run length functions.