Previous research [Applied Acoustics 66, pp.709-730, 2005] has shown that adding a cover based on a quadratic residue diffuser (QRD) design to the top of a T-shape barrier can provide significant improvement to the barrier performance. Such a design was adopted and successfully implemented in a railroad noise control project in Hong Kong [Internoise 2008 paper in08_0164]. The insertion loss performance of the production barrier was found to contain the predicted features of the diffusive barrier design, but the magnitude of the loss fell short of the prediction. Despite of this shortfall, it was still found to be significantly better than other alternative designs, and was subsequently chosen for the project. In this paper, we aim to determine the possible causes for this shortfall. The result should give guidance to how to avoid this reduction in performance so that the full potential of this diffusive barrier design can be achieved in future production products.