In this paper, we proposed a new technique to realize a high-quality three-dimensional (3D) display by using binary holograms. First, we applied a localized random down-sampling (LRDS) mask to down-sample the object function and generated a binary CGH by direct sign-thresholding. Subsequently, we devised the display by adaptive intensity accumulation (AIA). In AIA, multiple CGHs of the same object are generated. However, selective sampling points of the same scene are removed according to the reconstructed image of previous binary CGHs as the second and more binary CGHs are generated. Finally, these holograms are sequentially displayed on a fast spatial light modulator, a digital micromirror device (DMD). Thus, a high-quality 3D image is reconstructed without artifacts and speckle noise.