An accurate estimation of the time difference of arrival (TDOA) is crucial in localization, communication, and navigation. However, a low signal-to-noise ratio (SNR) can decrease the reliability of the TDOA estimation result. Therefore, this study aims to improve the performance of the TDOA estimation of dual-channel sensors for single-sound sources in low-SNR environments. This study introduces the theory of time rearrangement synchrosqueezing transform (TRST) into the time difference of arrival estimation. While the background noise TF points show random time delays, the signal time-frequency (TF) points originating from uniform directions that exhibit identical lags are considered in this study. In addition, the time difference rearrangement synchrosqueezing transform (TDST) algorithm is developed to separate the signal from the background noise by exploiting its distinct time delay characteristics. The implementation process of the proposed algorithm includes four main steps. First, a rough estimation of the time delay is performed by calculating the partial derivative of the short-time cross-power spectrum. Second, a rearrangement operation is conducted to separate the TF points of the signal and noise. Third, the TF points on both sides of the time-delay energy ridge are extracted. Finally, a refined TDOA estimation is realized by applying the inverse Fourier transformation on the extracted TF points. Furthermore, a second-order-based time difference reassigned synchrosqueezing transform algorithm is proposed to improve the robustness of the TDOA estimation by enhancing the TF energy aggregation. The proposed algorithms are verified by simulations and experiments. The results show that the proposed algorithms are more robust and accurate than the existing algorithms.