Phase analysis based on high-quality pixel (HQP) is crucial to ensure the measurement accuracy of ground-based SAR (GB-SAR). The amplitude dispersion (ADI) criterion has been widely applied to identify pixels with high amplitude stability, i.e., permanent scatterers (PSs), which typically are point-wise scatterers such as stones or man-made structures. However, the PS number in natural scenes is few and limits the GB-SAR applications. This paper proposes an improved method to take HQP selection applied for natural scenes in GB-SAR interferometry. In order to increase the spatial density of HQP for phase measurement, three types of HQPs including PS, quasi-permanent scatter (QPS), and distributed scatter (DS), are selected with different criteria. The ADI method is firstly utilized to take PS selection. To select those pixels with high phase stability but moderate amplitude stability, the temporal phase coherence (TPC) is defined. Those pixels with moderate ADI values and high TPC are selected as QPSs. Then the feasibility of the DS technique is explored. To validate the feasibility of the proposed method, 2370 GB-SAR images of a natural slope are processed. Experimental results prove that the HQP number could be significantly increased while slightly sacrificing phase quality.