The quality of water in urban parks is closely related to people’s daily lives, but the pollution caused by microplastics in park water and sediments has not been comprehensively studied. Therefore, eight typical parks in the urban area of Changsha, China, were selected, and Raman spectroscopy was used to explore the spatial distributions and compositions of the microplastics in the water and sediments, analyze their influencing factors, and evaluate their environmental risks. The results showed that the abundances of surface water microplastics in all parks ranged from 150 to 525 n L−1, and the abundances of sediment microplastics ranged from 120 to 585 n kg−1. The microplastics in the surface water included polyethylene terephthalate (PET), chlorinated polyethylene (CPE), and fluororubber (FLU), while those in the sediments included polyvinyl chloride (PVC), wp-acrylate copolymer (ACR), and CPE. Regression analyses revealed significant positive correlations between human activities and the abundances of microplastics in the parks. Among them, the correlations of population, industrial discharge and domestic wastewater discharge with the abundance of microplastics in park water were the strongest. However, the correlations of car flow and tourists with the abundance of microplastics in park water were the weakest. Based on the potential ecological risk indices (PERI) classification assessment method, the levels of microplastics in the waters and sediments of the eight parks were all within the II-level risk zone (53–8,549), among which the risk indices for Meixi Lake and Yudai Lake were within the IV risk zone (1,365–8,549), which may have been caused by the high population density near the park. This study provides new insights into the characteristics of microplastics in urban park water and sediment.