When multiple Virtual Synchronous Generators (VSGs) operate in parallel in an islanded grid, power and frequency oscillations will occur when one VSG goes offline. However, the existing literature does not cover the related analysis and transient suppression schemes for this scenario. To analyze these complex high-order system dynamics, this paper first establishes an intuitive equivalent circuit model for multiple VSGs, and the frequency domain expressions of the multi-machine VSG system during the VSG offline transient simulation are then derived. Based on the multi-VSG model and its transient oscillations analysis, this paper further proposes a configuration scheme for the equivalent circuit parameters. Equivalently, the virtual inertia, damping coefficient and virtual impedance of the VSGs can be configured. With the proposed parameter configuration scheme, the power oscillation during the VSG offline transient can be eliminated, as verified by experiments with a microgrid lab platform using three VSGs. Compared with the existing multi-VSG studies, the proposed scheme is not only the first attempt to study the transient suppression when a VSG goes offline, but also is more intuitive in analysis and less complicated in the controller parameter tuning.