Crowd management has become an integral part of urban planning in abnormality in the crowd and predict its future issues. Big data in social media is a rich source for researchers in crowd data analysis. In this systematic literature review (SLR), modern societies. It can organize the flow of the crowd, perform counting, recognize the related works are analyzed, which includes crowd management from both global and local sides (Hajj events—Saudi Arabia) based on deep learning (DL) methods. This survey concerns crowd management research published from 2010 to 2023. It has specified 45 primary studies that accomplish the objectives of the research questions (RQs), namely, investigation of the taxonomies, approaches, and comprehensive studies of crowd management both globally and locally and focusing on the most commonly used techniques of DL. We found both supervised and unsupervised DL techniques have achieved high accuracy, with different strengths and weaknesses for each approach. A lot of these studies discuss aspects of scene analysis of crowds, that are captured by installed cameras in the place. However, there is a dilemma regarding exploiting data provided on social media to use in the crowd analysis domain. Which we believe that the analysis of big data may raise crowd management to the upper level of enhancement. To this end, motivated by the findings of this SLR. The primary purpose of this review is strived to illustrate obstacles and dilemmas in crowd analysis fields to provide a road map for future researchers. Furthermore, it aims to find research gaps existing to focus on it in the future studies. The results indicate that the lack of Hajj research, especially in sentiment analysis and the study of the pilgrims' behavior.