In this paper, we demonstrate a color holographic system without undesirable light based on area sampling of a digital lens. This system, which improves the quality of the reconstructed color image, is fundamentally realized by using three spatial light modulators and a rectangle aperture. By altering the sampling area of the digital lens on the spatial light modulator panels, we can control the offset position of the reconstructed image. Thus, the zero‐order diffraction light as the undesirable light and the reconstructed images are separated, and the chromatic aberration can be corrected. In addition, a rectangle aperture is used to eliminate the zero‐order diffraction light. The final reconstructed image with improved quality can be observed, which verifies the effectiveness of our proposed system.