We present temporal compressive holographic microscopy to achieve high-speed phase imaging with a low-speed camera. In this method, alternating deep denoising network and total variation denoiser are combined into a plug-and-play framework to reconstruct ten high-speed holographic frames from a single-shot measurement. Therefore, we can observe a 500 frame per second (fps) holographic scene when the camera works at 50 fps. This technique provides an effective tool to detect dynamic phase change scenes.