A grain growth model based on a two-dimensional local curvature multi-vertex model in the presence of pinning particles was developed. This model is a physical model which pursues the minimum total grain boundary energy as the evaluation function, where the unpinning conditions are as follows. The first unpinning condition is that the total energy of the unpinned grain boundary is smaller than the total energy of the pinned grain boundary. The second unpinning condition is that the energy of the grain boundary necessary to surpass the energy barrier is assumed to be smaller than the jumping energy, which is presumably assisted by thermal lattice vibration. Using only the first condition, the Zener pinning effect caused by the finely dispersed particles during normal grain growth was reproduced. With the second condition, the selective abnormal grain growth was reproduced when the abnormally grown grain was surrounded by the grains with low-energy grain boundaries.