A key target to boost solar‐to‐chemical conversion processes is to fabricate an efficient solar‐light‐responsive photocatalyst. Herein, we report the in situ synthesis of nanoparticles (NPs) of Bi2O3 directly on Zn‐based layered double hydroxide (LDHs) frameworks. The in situ synthesis of Bi2O3NPs is done at room temperature, is ligand free and explores the ability of calcined ZnMeLDHs to reconstruct their layered structures in Bi(NO3)3 aqueous solution. The in situ formation of Bi2O3NPs on ZnMeLDHs is assessed by transmission electron microscopy (TEM), X‐ray photoelectron spectroscopy (XPS), powder X‐ray diffraction (XRD), and UV/Vis spectroscopy and compared with the features of a corresponding Bi2O3NPs/LDH prepared by the conventional impregnation route. The rapid photocatalytic response of the Bi2O3NPs/ZnMeLDH (Me=Al, Cr) heterostructures is confirmed by O2 generation from water under solar‐light irradiation. The rate of O2 generation increases by a factor of approximately 2 for the ZnCrLDH based catalysts as compared to that of the family of ZnAlLDH catalysts. Further, the presence of the bismuth phase and its nano‐dimension leads to increased efficiency for the in situ prepared Bi2O3NPs/LDHs as compared to that of impregnated Bi2O3/LDH and the pristine LDHs.