Math learning difficulty (MLD) is a learning disorder characterized by persistent impairments in the understanding and application of numbers independent of intelligence or schooling. The current study aims to review existing neuroimaging studies to characterize the neurobiological basis in MLD for their quantity and arithmetic dysfunctions. We identified a total of 24 studies with 728 participants through the literature. Using the activation likelihood estimate (ALE) method, we found that the most consistent neurobiological dysfunction in MLD was observed in the right intraparietal sulcus (IPS) with distinct patterns of the anterior and posterior aspects. Meanwhile, neurobiological dysfunctions were also observed in a distributed network including the fusiform gyrus, inferior temporal gyrus, insula, prefrontal cortex, anterior cingulate cortex, and claustrum. Our results suggest a core dysfunction in the right anterior IPS and left fusiform gyrus with atypically upregulated functions in brain regions for attention, working memory, visual processing, and motivation, serving as the neurobiological basis of MLD.