In this paper, the magnetoelectric (ME) effect is investigated in two kinds of A-line shape Terfenol-D/PZT-5A structures by changing the position of the NdFeB permanent magnet. The experimental results show that both ME composite structures had multiple resonance peaks. For the ME structure with acrylonitrile-butadiene-styrene (ABS) trestles, the resonance peak was different for different places of the NdFeB permanent magnet. Besides, the maximum of the ME coefficient was 4.142 V/A at 32.2 kHz when the NdFeB permanent magnet was on top of the Terfenol-D layer. Compared with the ME coefficient with a DC magnetic field, the ME coefficient with NdFeB magnets still maintained high values in the frequency domain of 65~87 kHz in the ME structure with mica trestles. Through Fourier transform analysis of the transient signal, it is found that the phenomenon of multiple frequencies appeared at low field frequency but not at high field frequency. Moreover, the output ME voltages under different AC magnetic fields are shown. Changing the amplitude of AC magnetic field, the magnitude of the output voltage changed, but the resonant frequency did not change. Finally, a finite element analysis was performed to evaluate the resonant frequency and the magnetic flux distribution characteristics of the ME structure. The simulation results show that the magnetic field distribution on the surface of Terfenol-D is non-uniform due to the uneven distribution of the magnetic field around NdFeB. The resonant frequencies of ME structures can be changed by changing the location of the external permanent magnet. This study may provide a useful basis for the improvement of the ME coefficient and for the optimal design of ME devices.