Neighborhood social and built environments have been recognized as important contexts in which health is shaped. We review the extent to which these neighborhood factors have been addressed in population-level cancer research, with a scan of the literature for research that focuses on specific social and/or built environment characteristics and association with outcomes across the cancer continuum, including incidence, diagnosis, treatment, survivorship, and survival. We discuss commonalities and differences in methodologies across studies, current challenges in research methodology, and future directions in this research area. The assessment of social and built environment factors in relation to cancer is a relatively new field, with 82% of 34 reviewed papers published since 2010. Across the wide range of social and built environment exposures and cancer outcomes considered by the studies, numerous associations were reported. However, the directions and magnitudes of association varied, due in large part to the variation in cancer sites and outcomes being studied, but also likely due to differences in study populations, geographical region, and, importantly, choice of neighborhood measure and geographic scale. We recommend that future studies consider the life course implications of cancer incidence and survival, integrate secondary and self-report data, consider work neighborhood environments, and further develop analytical and statistical approaches appropriate to the geospatial and multilevel nature of the data. Incorporating social and built environment factors into research on cancer etiology and outcomes can provide insights into disease processes, identify vulnerable populations, and generate results with translational impact of relevance for interventionists and policy makers.