Land use change (LUC) has direct and indirect consequences on soil quality. To gain insight into how LUC influences the physical properties of soil, it can be advantageous to compare undisturbed ecosystems with those that have naturally evolved over time, as well as to use soil quality indices to pinpoint the sensitivity of each ecosystem and land use change (LUC). A soil survey was carried out in the six major ecosystems of the Nilgiri Hill Region: cropland (CL), deciduous forest (DF), evergreen forest (EF), forest plantation (FP), scrubland (SL), and tea plantation (TP), with those having an establishment for over 50 years being selected and analyzed for soil physical parameters. In addition, soil quality indices were also derived to pinpoint the vulnerability of each ecosystem to LUC. The results reveal that the changes in land use significantly altered the soil physical properties. The content of clay was higher in EF and DF and increased with the soil profile’s depth, whereas the sand content was higher in CL and TP and decreased with the depth increment. BD and PD were significantly lower in EF, DF, SL, and FP, whereas they were higher in CL and TP. PS and ASM followed a similar trend to BD and PD. Owing to undisturbed natural settings, an abundance of litter input, and higher carbon concentrations, the HC was higher in EF, DF, SL, and FP, whereas, in the case of anthropogenic-influenced ecosystems such as CL and TP, it was lower. We discovered that LUC has altered Ag S, WSA, and MWD. Due to tillage and other cultural practices, Ag S, WSA, and MWD were significantly lower in CL and TP. However, the results confirm that native ecosystems (EF and DF) with a higher carbon content prevent such degradation, thereby resulting in good Ag S, WSA, and MWD.