The accurate and effective estimation of forest carbon density is an essential basis for effectively responding to climate change and achieving the goal of carbon neutrality. Aiming at the problem of the significant differences in the forest carbon model parameters of different tree species, this study used the tree forest in Yueyang City, Hunan Province, China, as the study object and used the random forest classification algorithm through the Google Earth Engine platform to classify the dominant tree species within the forested range of the study area based on the image elements. The overall accuracy in the forest/non-forest classification (primary classification) was 93.79% with a Kappa of 0.9145. The overall accuracy in the dominant species classification (secondary classification) was 87.30% with a Kappa of 0.7747. Based on the classification, a multiple linear regression (MLR), support vector machine (SVM), and random forest (RF) were constructed for different dominant tree species by combining some Forest Resource Inventory data and remote sensing data. The results showed that the RF model had a significantly higher coefficient of determination (R2 = 0.4054–0.7602) than the MLR (R2 = 0.0900–0.4070) and SVM (R2 = 0.1650–0.4450) as well as a substantially lower RMSE and MAE; its spatial distribution of forest carbon density ranged from 3.06 to 62.80 t·hm−2. Compared with the spatial distribution of the forest carbon density (4.64 to 31.96 t·hm−2) without the classification of dominant species, the method eliminated the problems of severe overfitting and significant underestimation of peak values when estimating under unclassified conditions. The method provides a reference for the remote sensing inversion of forest carbon density on a large scale.