The separation of time–frequency mixing signals composed of radar, communication, and jamming is the first step in integrated reception processing, which requires higher accuracy for complex blind source separation (CVBSS). However, traditional CVBSS methods have limitations such as low separation accuracy, a slow convergence speed, and poor robustness in low signal-to-noise ratio (SNR) and high jamming-to-signal ratio (JSR) scenarios. To address the above issues, this paper firstly establishes a time delay mixing mathematical model. A robust whitening algorithm is proposed by using the time delay correlation matrix of the observed signal, which is insensitive to noise. Secondly, the joint diagonalized F-parametrization is used as the objective function, and the separation matrix is constructed based on the multiple complex-valued Givens matrices. The complex-valued Givens matrix not only ensures orthogonality in the separation matrix but also effectively reduces the number of parameters to be calculated. This approach guarantees accuracy and simplifies the complexity of the separation process. Finally, the nonlinear chaotic grey wolf optimizer is utilized to search for the optimal rotation angle. The simulation results demonstrate that this algorithm offers higher separation accuracy and requires fewer iterations compared to the traditional algorithm. Additionally, it enhances the accuracy of direction of arrival (DOA) estimation, reduces the communication bit error rate, and enables the joint estimation of the target distance and velocity even in the presence of powerful jamming and a low SNR.