Percutaneous kidney biopsy is essential for diagnosing various kidney diseases. However, insufficient glomerular yield leads to misdiagnosis, a critical problem. We retrospectively investigated the risk of insufficient glomerular yield in percutaneous kidney biopsies. We included 236 patients who underwent percutaneous kidney biopsies between April 2017 and September 2020. We retrospectively analyzed the relationship between glomerular yield and patient characteristics. After the biopsy, 31 patients produced insufficient glomerular yields (cases with yielded glomeruli <10). Glomerular yield correlated negatively with hypertension (β = −0.13, p = 0.04), and positively with glomerular density (β = 0.59, p < 0.0001) and the volume of the biopsy core (number of punctures, number of biopsy cores, total length of biopsy core, length of core collected by one puncture, and cortical length). Patients yielding <10 glomeruli had lower glomerular densities (14.4 ± 1.6 vs. 22.9 ± 0.6/cm; p < 0.0001). These results suggest that glomerular density is crucial to glomerular yield. Furthermore, glomerular density was negatively correlated with hypertension, diabetes, and age. Hypertension was independently associated with low glomerular density (β = −0.16, p = 0.02). Thus, the glomerular yield was associated with glomerular density and biopsy core length, and hypertension might be related to glomerular yield via low glomerular density.