A publication by McCargar and Zurk [J. Acoust. Soc. Am. 133(4), EL320–EL325 (2013)] introduced a passive source depth estimation method for a moving tonal source with a vertical line array (VLA), utilizing the depth-dependent modulation in the arrival angle domain caused by the interference between the direct and surface-reflected acoustic arrivals. Under the isovelocity approximation, this method can estimate the depth of sources at close ranges, but the depth estimation error will increase with the increase in source range, as the impact of the sound speed profile on sound propagation is ignored. This paper presents a theoretical formula for calculating the modeled interference structure in the arrival angle domain with the knowledge of the sound speed profile. By matching the measured interference structure obtained from the beamforming of the acoustic data received by the VLA with the modeled structure under different assumed source depths, the tonal source depth estimation is achieved, even for sources at the remote part of the direct arrival zone. The performance of this method is verified by simulation data, as well as experimental data radiated from a towed source and a non-cooperative passing ship.