Organic solar cells based on wide band gap polymers and nonfullerene smallmolecule acceptors have demonstrated remarkably good device performances. Nevertheless, a thorough understanding of the charge-transfer process in these materials has not been achieved yet. In this study, we use Fano resonance signals caused by the interaction of broad electronic charge carrier absorption and the molecular vibrations of the electron acceptor molecule to monitor the charge-transfer state dynamics. In our time-resolved infrared spectroscopy experiments, we find that in the small-molecule acceptor, they have additional dynamics on the order of a few picoseconds. A change in the solvent used in thin film deposition, leading to different morphologies, influences this time further. We interpret our findings as the dynamics of the charge-transfer state at the interface of the electron donor and the electron-acceptor. The additional mid-infrared transient signal is generated in this state, as both electron and hole polarons can interact with small-molecule acceptor vibrational modes.