Finishing operations are one of the most challenging tasks during a manufacturing process, and are responsible for achieving dimensional accuracy of the manufactured parts and the desired surface topography properties. One of the most advanced finishing technologies is grinding. However, typical grinding processes have limitations in the acquired surface topography properties, especially in finishing difficult to cut materials such as Inconel 625. To overcome this limitation, a new type of grinding wheel is proposed. The tool is made up of grains of different sizes, which results in less damage to the work surface and an enhancement in the manufacturing process. In this article, the results of an experimental study of the surface grinding process of Inconel 625 with single-granular and multi-granular wheels are presented. The influence of various input parameters on the roughness parameter (Sa) and surface topography was investigated. Statistical models of the grinding process were developed based on our research. Studies showed that with an increase in the cutting speed, the surface roughness values of the machined samples decreased (Sa = 0.9 μm for a Vc of 33 m/s for a multigranular wheel). Observation of the grinding process showed an unfavorable effect of a low grinding wheel speed on the machined surface. For both conventional and multigranular wheels, the highest value for the Sa parameter was obtained for Vc = 13 m/s. Regarding the surface topography, the observed surfaces did not show defects over large areas in the cases of both wheels. However, a smaller portion of single traces of active abrasive grains was observed in the case of the multi-granular wheel, indicating that this tool performs better finishing operations.