The reconstruction of object images that are located in 3D scene cross-sections using digital holography is described. The potential of generative adversarial networks for reconstructing cross-sections of 3D scenes composed of multiple layers of off-axis objects from holograms is investigated. Such scenes consist of a series of sections with objects that are not aligned with the camera’s axis. Digital holograms were used to reconstruct images of cross-sectional views of 3D scenes. It has been shown that the use of neural networks increases the speed and reconstruction quality, and reduces the image noise. A method for reconstructing images of objects using digital off-axis holograms and a generative adversarial neural network is proposed. The proposed method was tested on both numerically simulated and experimentally captured digital holograms. It was able to successfully reconstruct up to 8 cross-sections of a 3D scene from a single hologram. It was obtained that an average structural similarity index measure was equal to at least 0.73. Based on optically registered holograms, the method allowed us to reconstruct object image cross-sections of a 3D scene with a structural similarity index measure over cross-sections of a 3D scene of equal to 0.83. Therefore, the proposed technique provides the possibility for high-quality object image reconstruction and could be utilized in the analysis of micro- and macroobjects, including medical and biological applications, metrology, characterization of materials, surfaces, and volume media.