Renewable generation, such as solar PV and wind power, is commonly integrated into the power grid through inertialess power electronic interfaces (PEIs). Due to the increasing penetration of renewable generation, the frequency stability of the current power system deteriorates. In order to sustain the desired level of the overall inertia, the virtual synchronous generator (VSG) algorithm has been proposed. The concept of VSG is to enable the PEIs to emulate the external properties of traditional synchronous generators (SGs), such as inertia and primary frequency responses. By exploitation of the well-established knowledge system of conventional SG-based power grids, the VSG can also be implemented with the capabilities of primary, secondary, and tertiary frequency control in multiple temporal stages. This paper focuses on parameter tuning for VSG-PEIs by performance indices. The emulation strategies are completed with the capability of secondary and tertiary frequency regulation. The transfer functions of the dynamic systems of PEIs are simplified and referred to the control theory. The composite influences of different parameters on performance indices are analyzed. The methods of the parameter tuning are proposed according to the temporal sequences of the control stages. By typical performance standards, the proposed method is verified through simulation.