In wafer metrology, the knowledge of the photomask together with the deposition process only reveals the approximate geometry and material properties of the structures on a wafer as a priori information. With this prior information and a parametrized description of the scatterers, we demonstrate the performance of the Gauss–Newton method for the precise and noise-robust reconstruction of the actual structures, without further regularization of the inverse problem. The structures are modeled as 3D finite dielectric scatterers with a uniform polygonal cross-section along their height, embedded in a planarly layered medium. A continuous parametrization in terms of the homogeneous permittivity and the vertex coordinates of the polygons is employed. By combining the global Gabor frame in the spatial spectral Maxwell solver with the consistent parametrization of the structures, the underlying linear system of the Maxwell solver inherits all the continuity properties of the parametrization. Two synthetically generated test cases demonstrate the noise-robust reconstruction of the parameters by surpassing the reconstruction capabilities of traditional imaging methods at signal-to-noise ratios up to −3dB with geometrical errors below λ/7, where λ is the illumination wavelength. For signal-to-noise ratios of 10 dB, the geometrical parameters are reconstructed with errors of approximately λ/60, and the material properties are reconstructed with errors of around 0.03%. The continuity properties of the Maxwell solver and the use of prior information are key contributors to these results.