The performance of an antenna array is considerably affected by mutual coupling effects between antenna elements. When a large number of antenna elements are located close to each other, mutual coupling becomes more significant. In this study, by using a new mutual impedance matrix, a decoupling methodology for compensating mutual coupling effects in a practical very high frequency (VHF)/ultra high frequency (UHF) Yagi-Uda antenna array is introduced. No previous publications have studied VHF/UHF Yagi-Uda antenna arrays in this context. In the proposed scheme, extreme care has been taken to account for both self-and mutual impedance related to mutual coupling effects. Experimental and simulation results show that using the proposed method, a perfect decoupling is achieved. The application of high-resolution direction of arrival (DOA) estimation algorithms in decoupled experimental data leads to excellent performance of DOA estimation, in terms of accuracy and resolution. In addition, it is concluded (from experimental and simulation results) that mutual coupling effects between array elements as well as the root-mean-square error of estimated parameters depend on the direction of arrival. It is also deduced that in the presence of mutual coupling, estimation of signal parameter via rotation invariance techniques algorithm performs better than other subspace-based algorithms.