In civil and mechanical engineering, Bayesian inverse methods may serve to calibrate the uncertain input parameters of a structural model given the measurements of the outputs. Through such a Bayesian framework, a probabilistic description of parameters to be calibrated can be obtained; this approach is more informative than a deterministic local minimum point derived from a classical optimization problem. In addition, building a response surface surrogate model could allow one to overcome computational difficulties. Here, the general polynomial chaos expansion (gPCE) theory is adopted with this objective in mind. Owing to the fact that the ability of these methods to identify uncertain inputs depends on several factors linked to the model under investigation, as well as the experiment carried out, the understanding of results is not univocal, often leading to doubtful conclusions. In this paper, the performances and the limitations of three gPCE-based stochastic inverse methods are compared: the Markov Chain Monte Carlo (MCMC), the polynomial chaos expansion-based Kalman Filter (PCE-KF) and a method based on the minimum mean square error (MMSE). Each method is tested on a benchmark comprised of seven models: four analytical abstract models, a one-dimensional static model, a one-dimensional dynamic model and a finite element (FE) model. The benchmark allows the exploration of relevant aspects of problems usually encountered in civil, bridge and infrastructure engineering, highlighting how the degree of non-linearity of the model, the magnitude of the prior uncertainties, the number of random variables characterizing the model, the information content of measurements and the measurement error affect the performance of Bayesian updating. The intention of this paper is to highlight the capabilities and limitations of each method, as well as to promote their critical application to complex case studies in the wider field of smarter and more informed infrastructure systems.