Spectral rigidity in Hermitian quantum chaotic systems signals the presence of dynamical universal features at time scales that can be much shorter than the Heisenberg time. We study the analogue of this time scale in many-body non-Hermitian quantum chaos by a detailed analysis of long-range spectral correlators. For that purpose, we investigate the number variance and the spectral form factor of a non-Hermitian q-body Sachdev-Ye-Kitaev (nHSYK) model, which describes N fermions in zero spatial dimensions. After an analytical and numerical analysis of these spectral observables for non-Hermitian random matrices, and a careful unfolding, we find good agreement with the nHSYK model for q > 2 starting at a time scale that decreases sharply with q. The source of deviation from universality, identified analytically, is ensemble fluctuations not related to the quantum dynamics. For fixed q and large enough N , these fluctuations become dominant up until after the Heisenberg time, so that the spectral form factor is no longer useful for the study of quantum chaos. In all