Aiming at the security issues in the storage and transmission of medical images in the medical information system, combined with the special requirements of medical images for the protection of lesion areas, this paper proposes a robust zero-watermarking algorithm for medical images’ security based on VGG19. First, the pretrained VGG19 is used to extract deep feature maps of medical images, which are fused into the feature image. Second, the feature image is transformed by Fourier transform, and low-frequency coefficients of the Fourier transform are selected to construct the feature matrix of the medical image. Then, based on the low-frequency part of the feature matrix of the medical image, the mean-perceptual hashing algorithm is used to achieve a set of 64-bit binary perceptual hashing values, which can effectively resist local nonlinear geometric attacks. Finally, the algorithm adopts a watermarking image after scrambling and the 64-bit binary perceptual hashing value to obtain robust zero-watermarking. At the same time, the proposed algorithm utilizes Hermite chaotic neural network to scramble the watermarking image for secondary protection, which enhances the security of the algorithm. Compared with the existing related works, the proposed algorithm is simple to implement and can effectively resist local nonlinear geometric attacks, with good robustness, security, and invisibility.