We propose a novel numerical method for solving inverse problems subject to impulsive noises which possibly contain a large number of outliers. The approach is of Bayesian type, and it exploits a heavy-tailed t distribution for data noise to achieve robustness with respect to outliers. A hierarchical model with all hyper-parameters automatically determined from the given data is described.An algorithm of variational type by minimizing the Kullback-Leibler divergence between the true posteriori distribution and a separable approximation is developed. The numerical method is illustrated on several one-and two-dimensional linear and nonlinear inverse problems arising from heat conduction, including estimating boundary temperature, heat flux and heat transfer coefficient. The results show its robustness to outliers and the fast and steady convergence of the algorithm. key words: impulsive noise, robust Bayesian, variational method, inverse problems
IntroductionWe are interested in Bayesian approaches for inverse problems subject to impulsive noises. Bayesian inference provides a principled framework for solving diverse inverse problems, and has demonstrated distinct features over deterministic techniques, e.g., Tikhonov regularization. Firstly, it can yield an ensemble of plausible solutions consistent with the given data. This enables quantifying the uncertainty of a specific solution, e.g., with credible intervals. In contrast, deterministic techniques generally content with singling out one solution from the ensemble. Secondly, it provides a flexible regularization since hierarchical modeling can partially resolve the nontrivial issue of choosing an appropriate regularization parameter.It is known that the underlying mechanism is balancing principle [22]. Thirdly, it allows seamlessly integrating structural/multiscale features of the problem through careful prior modeling. Therefore, it has attracted attention in a wide variety of applied disciplines, e.g., geophysics [37,34], medical imaging * [18, 27, 1] and heat conduction [13,39, 40,14], see also [32,28,30,31] for other applications. For an overview of methodological developments, we refer to the monographs [37,26].Amongst existing studies on Bayesian inference for inverse problems, the Gaussian noise model has played a predominant role. This is often justified by appealing to central limit theorem. The theorem asserts that the normal distribution is a suitable model for data that are formed as the sum of a large number of independent components. Even in the absence of such justifications, this model is still preferred due to its computational/analytical conveniences, i.e., it allows direct computation of the posterior mean and variance and easy exploration of the posterior state space (for linear models with Gaussian priors). A well acknowledged limitation of the Gaussian model is its lack of robustness against the outliers, i.e., data points that lie far away from the bulk of the data, in the observations: A single aberrant data point can significantly influ...