This paper mainly studies the association between non-binary low-density parity-check codes and high-order partial response continuous phase modulation, which prevents information loss in the mutual conversion of bit and symbol probabilities. Although the iterative detection and decoding technique applied in this system can obtain good performance/complexity tradeoff, the iterative process still encounters the problems of positive feedback and relatively large decoding delay, similar to other iterative coded modulation systems. The inhibitory effects of different extrinsic information exchange methods on positive feedback under different signal-to-noise ratio (SNR) conditions are investigated in this work to address this issue. Two dynamic iterative stopping algorithms, namely, cross entropy and hard decision aided combined with weighted extrinsic information exchange for cases with medium and high SNRs, are then proposed. Extrinsic information exchange between the demodulator and the decoder is conducted in the two algorithms through weighted processing. Iterative detection is subsequently performed based on two stopping criteria of dynamic iterative decoding. Theoretic analysis and simulation results for the Rayleigh fading channel show that the combination of weighted extrinsic information exchange and the two dynamic iterative stopping algorithms effectively resists positive feedback and improves the convergence of iterative detection and bit error rate performance. Such a combination also reduces the average iteration number to improve the real-time performance of iterative detection and decoding.