Despite the abundance of tree diversity in the natural world, and generally high tree species richness in urban areas, urban forests continue to be dominated by a limited number of species. As socio-ecological systems, urban forests are shaped by historical and current management efforts and decision-making of a wide range of human actors. Drawing on past research, we offer a conceptual framework for describing the complex interactions among tree producers and consumers as trees are selected, grown, specified, and planted in private and public urban areas. We illustrate how multiple layers of selection criteria filter down the entirety of potential local tree diversity to a handful of commonly used and accepted tree species. We detail the actors and decision makers who impact tree composition and diversity across several land types. Finally, we identify research, education and outreach needs as they relate to creating more diverse and resilient urban forest ecosystems.