(1) Background: Anemia has comprehensive adverse effects on the growth and development of children. In this study, we analyzed the potential effects of different types of anemia on early-life neurobehavioral development. (2) Methods: A total of 2601 children aged 6–24 months, whose parents agreed to participate in this study, underwent routine blood tests and neurobehavioral development assessment. The children’s parents or other primary caregivers were interviewed with a face-to-face questionnaire at the time of enrollment in the study. Anemia was determined by hemoglobin < 110 g/L and classified into iron-deficiency and non-iron-deficiency anemia according to the levels of serum ferritin, C-reactive protein, and alpha-1-acid glycoprotein. Neurobehavioral development was assessed by the China Developmental Scale for Children and divided into five domains: gross motor, fine movement, adaptability, language, and social behavior. The development quotient (DQ) was used to measure the level of total neurobehavioral development and each domain of neurobehavioral development. (3) Results: The prevalence of anemia in children aged 6–24 months was 26.45%, of which iron-deficiency anemia only accounted for 27.33%. Compared with children without anemia, those with iron-deficiency anemia had a significantly lower developmental quotient (DQ) for total neurobehavioral development and gross motor and adaptability development. The partial regression coefficients were −1.33 (95% CI −2.36, −0.29; p = 0.012), −1.88 (95% CI −3.74, −0.03; p = 0.047), and 1.48 (95% CI −2.92, −0.05; p = 0.042), respectively. Children with non-iron-deficiency anemia had significantly lower DQ for total neurobehavioral development and gross motor and fine movement development than those without anemia. The partial regression coefficients were −0.94 (95% CI −1.64, −0.25; p = 0.008), −1.25 (95% CI −2.48, −0.03; p = 0.044), and −1.18 (95% CI −2.15, −0.21; p = 0.017), respectively. There were no statistically significant differences in total neurobehavioral development and the five domains of neurobehavioral development between children with non-iron-deficiency and iron-deficiency anemia. The partial β values were 0.40 (95% CI −1.53, 2.33; p = 0.684), 0.21 (95% CI −1.39, 1.81; p = 0.795), 0.63 (95% CI −1.03, 2.28; p = 0.457), 0.16 (95% CI −1.78, 2.10; p = 0.871), 0.35 (95% CI −1.32, 2.01; p = 0.684), and 0.34 (95% CI −0.77, 1.46; p = 0.545), respectively. (4) Conclusions: Both iron-deficiency anemia and non-iron-deficiency anemia were negatively correlated with the neurobehavioral development of children. Negative correlations were found between iron-deficiency anemia and gross motor and adaptability development and between non-iron-deficiency anemia and gross motor and fine movement development.