This study considers a class of double finite Hankel transforms that describes the transmission of a vortex optical signal through a two-lens system with limited aperture radii in the object and spectral flats. The eigenfunctions of the given transform are calculated for different orders of vortex m. The functions obtained are an orthonormal system of functions, which can help expand an unspecified limited optical allocation with high accuracy. Approximation of optical signals without radial symmetry is also performed in this paper.