Slip phenomena on plate interfaces reflect the heterogeneous physical properties of the slip plane and thus exhibit a wide variety of slip velocities and rupture propagation behaviors. Recent findings on slow earthquakes reveal similarities and differences between slow and regular earthquakes. Episodic tremor and slip (ETS) events, a type of slow earthquake widely observed in subduction zones, likewise show diverse activity. We investigated the growth of 17 ETS events beneath the Kii Peninsula in the Nankai subduction zone, Japan. Analyses of waveform data recorded by a seismic array enabled us to locate tremor hypocenters and estimate the migration patterns and spatial distribution of the energy release of tremor events. Here we describe three major features in the growth of ETS events. First, independent of their start point and migration pattern, ETS events exhibit patches of high seismic energy release on the up-dip part of the ETS zone, suggesting that the location of these patches is controlled by inherent physical or frictional properties of the plate interface. Second, ETS events usually start outside the high-energy patches, and their final extent depends on whether the patches participate in the rupture. Third, we recognize no size dependence in the initiation phase of ETS events of different sizes with comparable start points. These features demonstrate that the cascading rupture of high-energy patches governs the growth of ETS events, just as the cascading rupture of asperities govern the growth of regular earthquakes.