In recent years, various serious diseases caused by Zika virus (ZIKV) have made it impossible to be ignored. Confirmed existence of ZIKV in semen and sexually transmission of ZIKV suggested that it can break the blood–testis barrier (BTB), or Sertoli cell barrier (SCB). However, little is known about the underlying mechanism. In this study, interaction between actin, an important component of the SCB, and ZIKV envelope (E) protein domain III (EDIII) was inferred from co-immunoprecipitation (Co-IP) liquid chromatography–tandem mass spectrometry (LC–MS/MS) analysis. Confocal microscopy confirmed the role of actin filaments (F-actin) in ZIKV infection, during which part of the stress fibers, the bundles that constituted by paralleled actin filaments, were disrupted and presented in the cell periphery. Colocalization of E and reorganized actin filaments in the cell periphery of transfected Sertoli cells suggests a participation of ZIKV E protein in ZIKV-induced F-actin rearrangement. Perturbation of F-actin by cytochalasin D (CytoD) or Jasplakinolide (Jas) enhanced the infection of ZIKV. More importantly, the transepithelial electrical resistance (TEER) of an in vitro mouse SCB (mSCB) model declined with the progression of ZIKV infection or overexpression of E protein. Co-IP and confocal microscopy analyses revealed that the interaction between F-actin and tight junction protein ZO-1 was reduced after ZIKV infection or E protein overexpression, highlighting the role of E protein in ZIKV-induced disruption of the BTB. We conclude that the interaction between ZIKV E and F-actin leads to the reorganization of F-actin network, thereby compromising BTB integrity.