Conversion of curtilage land into cropland or grassland can have substantial effects on soil nutrition and microbial activities; however, these effects remain ambiguous. This is the first study to compare the soil organic carbon (SOC) fractions and bacterial communities in rural curtilage, converted cropland, and grassland compared with cropland and grassland. This study determined the light fraction (LF) and heavy fraction (HF) of organic carbon (OC), dissolved organic carbon (DOC), microbial biomass carbon (MBC), and the microbial community structure by conducting a high-throughput analysis. Curtilage soil had significantly lower OC content, the DOC, MBC, LFOC and HFOC of grassland and cropland soils were 104.11%, 55.58%, 264.17%, and 51.04% higher than curtilage soil averagely. Cropland showed notably high bacterial richness and diversity, with Proteobacteria (35.18%), Actinobacteria (31.48%), and Chloroflexi (17.39%) predominating in cropland, grassland, and curtilage soil, respectively. Moreover, DOC and LFOC contents of converted cropland and grassland soils were 47.17% and 148.65% higher than curtilage soil while MBC content was 46.24% lower than curtilage soil averagely. Land conversion showed more significant effects on microbial composition than land-use differences. The abundant Actinobacteria and Micrococcaceae population and the low MBC contents indicated a “hungry” bacterial state in the converted soil, whereas the high MBC content, Acidobacteria proportion, and relative abundance of functional genes in the fatty acid and lipid biosynthesis indicated a “fat” bacterial state in cropland. This study contributes to the improvement of soil fertility and the comprehension and efficient use of curtilage soil.