Bayesian inversion using maximum a posteriori (MAP) estimator is a quantitative approach that has been successfully applied to the electrical resistivity tomography inverse problem. In most approaches, model covariance parameters are generally chosen stationary and isotropic, which assumes statistical homogeneity of studied field.However, the statistical properties of resistivity within the Earth are, in reality, location depend due to spatially varying processes that control the bulk resistivity of rocks, such as water content, porosity, clay content, etc. In order to take into account the spatial variability of the resistivity field, we propose to use the non-stationary Matérn covariance family that is defined through linear stochastic partial differential equations. Two types of prior information are considered, structure orientation and spatially increasing range with increasing depth. The latter is applied successfully on the first synthetic model which aims at retrieving the depth of bedrock and the shape of conductive lens. In the second synthetic example, a conductive dyke model embedded into four layers is used to study the performance of structure orientation. Finally, the proposed approach is used to invert real data measured over an extensively characterized sandy-to-silty aquifer. Structure orientation of this aquifer was firstly determined by applying structure tensor calculated using gradients of gpr image. The introduction of this information gives a resistivity model that is more compatible with the aquifer structure.