Different from traditional image-plane encoding spectral imaging method, this paper proposes an object-plane encoding hyperspectral three-dimensional collaborative imaging method, which is based on the idea of spectral displacement invariance and multiplexing encoding and decoding. The 4D data of the scene is scanned by coded apertures generated by the projector, and then the encoded data of the scene is obtained. During the reconstruction process, there is no need for phase unwrapping operation or data fusion. The reconstruction result shows excellent performance with a spectral resolution of 3 nm, nearly 120 spectral bands, depth accuracy of 0.25 mm. Compared with the image-plane encoding spectral imaging method, the object-plane encoding spectral imaging method exhibits better anti-interference characteristics, and the reconstruction quality of the object-plane encoding spectral imaging method is better than that of the image-plane encoding spectral imaging method in the scattering environments.