In order to structure an efficient and comfortable commercial district for pedestrians, we need to understand the interaction between pedestrian walking behavior and the complex elements of the built environment. Previous studies have focused on people’s activities in the context of the neighborhood rather than the commercial district. This study investigates the potential associations between multi-dimensional environmental factors and pedestrians under various temporal distributions in a densely populated commercial district. Multi-source urban data and semantic segmentation technics have been adopted to measure the built environmental quality from four classic dimensions of urban design, and combining the observations of pedestrian volumes of representative streets in the commercial district, we assess the relationship between the two at different times on the basis of a generalized linear model (GLM). The analytical results identify that the Morphology, Visual perception, Function, and Street configuration features of the commercial environment have a significant impact on walking activity, and temporal differences exist. The findings highlight the importance of built environment quality to pedestrians and street attractiveness, and inform designers, stakeholders, and municipalities on the revitalization of traditional commercial districts.