Multiple studies have demonstrated strong links between diet and anemia, but few have explored the impact of food groups on hemoglobin (Hb). We analyzed the correlation between Ghanaian diet and Hb levels to explore reduction of anemia prevalence through dietary interventions. Demographics, food frequency questionnaires (FFQ), and blood samples were obtained from 140 volunteers (ages 18–65) in five locations across Ghana. Hb was measured; estimated iron consumption was calculated. FFQ items were grouped by food type, and a regression analysis was performed to determine the most important dietary predictors of Hb. Moreover, 47% of total participants were anemic; 64% of females and 28% of males. Hb levels were highest in Mole (13.9 g/dL, SD = ±1.9), independent of sex distribution. The regression model revealed a 62.7% adjusted correlation between food groups and Hb levels. Animal foods (β = 0.016, t = 5.08, p < 0.01) and plant protein (β = 0.013, t = 2.86, p < 0.01) were the most influential groups to Hb levels. It is of vital importance to emphasize the benefits of consuming animal foods and plant proteins within the Ghanaian population. The ease of access to plant proteins makes it likely that this food group will be most influential and have the greatest impact in reduction of anemia in the Ghanaian population.