Green ecological communities have garnered significant interest due to their role in providing urban ecosystem services, and community greening plays a pivotal role in urban environmental enhancement. In the context of carbon neutrality-oriented goals, it is imperative to acknowledge the significance of various landscape designs in carbon sequestration within community greening initiatives. However, there is currently a lack of consideration for landscape designs that promote high carbon sequestration in community greening projects. Our research with literature research and experimental measurement data as data sources, established a database of carbon sequestration of 138 common vegetation species in Shanghai. Based on the vertical vegetation structure within landscape design, we propose seven modular planting structures that reflect the carbon sequestration potential of high-capacity plants within different community green spaces. Our findings reveal substantial variations in carbon sequestration among different tree species within arbor and shrub categories, whereas the differences in carbon sequestration among various herbaceous plants per unit area are comparatively smaller. Among the different combination patterns, the highest carbon sequestration is achieved by the vegetation configuration of the three-layer structure pattern, and the combination of arbors, shrubs and grasses can maximize the effective use of space. This study holds significant importance in optimizing the utilization of limited green spaces within communities and enhancing the carbon sequestration benefits of community landscapes. Ultimately, these efforts contribute significantly to Shanghai's journey toward carbon neutrality.