Cities have a wide variety of green infrastructure types, such as parks and gardens. These structures can provide important ecosystem services (ES) with a major impact on human well-being. With respect to urban planning, special consideration must be given to such green infrastructure types when implementing measures to maintain and enhance the quality of life. Therefore, generating knowledge on the urban ES of differently scaled green infrastructure types is important. This systematic literature review provides an overview of existing studies which have explicitly investigated the urban ES of differently spatial-scaled green infrastructure types. By reviewing 76 publications, we confirm rising academic interest in this topic. The most frequently assessed urban ES belong to the category Regulating and Maintenance. Only a few have considered individual small structures such as green roofs or single gardens; green spaces are often aggregated into one, mostly city-wide, object of investigation, with resulting oversimplifications. Moreover, generalizing methods are mostly applied. Simultaneously, many studies have applied methods to evaluate location-specific primary data. More research is needed on small-scale structures, in particular to consider site-, and thus location-specific, parameters in order to successfully implement the ES concept into urban planning and to obtain realistic results for ES assessments.