By identifying the efficiently radiating acoustic radiation modes of a fluid loaded vibrating structure, the storage requirements of the acoustic impedance matrix for calculation of the sound power using the boundary element method can be greatly reduced. In order to compute the acoustic radiation modes, the impedance matrix needs to be symmetric. However, when using the boundary element method, it is often found that the impedance matrix is not symmetric. This paper describes the origin of the asymmetry of the impedance matrix and presents a simple way to generate symmetry. The introduction of additional errors when symmetrizing the impedance matrix must be avoided. An example is used to demonstrate the behavior of the asymmetry and the effect of symmetrization of the impedance matrix on the sound power. The application of the technique presented in this work to compute the radiated sound power of a submerged marine vessel is discussed.