In this paper, the Euclidean distance between the probability density functions (PDFs) for biased errors and a Dirac-delta function located at zero on the error axis is proposed as a new performance criterion for adaptive systems in non-Gaussian noise environments. Also, based on the proposed performance criterion, a supervised adaptive algorithm is derived and applied to adaptive equalization in the shallow-water communication channel distorted by severe multipath fading, impulsive and DC-bias noise. The simulation results compared with the performance of the existing MEDE algorithm show that the proposed algorithm yields over 5 dB of MSE enhancement and the capability of relocating the mean of the error PDF to zero on the error axis.