The walk score, which is widely used as an index of walkability, does not include pedestrian’s perception, so there is a limit to explaining the level of perceived walkability in a neighborhood. The purpose of this study is to examine how an objectively measured walk score and subjectively measured environmental perceptions correlate with perceived neighborhood walkability. This study conducted a survey on 371 participants aged 18 or older living in Daegu, South Korea to examine perceived neighborhood walkability and perception of the built environment. We measured the walk score based on participants’ location using a geographic information system. We used the quantile regression model, whereby we investigated the effects of explanatory variables (e.g., the walk score, perceptions of the built environment) by classifying perceived neighborhood walkability by quantile into Q10, Q25, Q50, Q75, and Q90. The walk score had a positive association with people with low perceived neighborhood walkability (Q10), but a negative association with people with high perceived neighborhood walkability (Q90). Regarding views of the built environment, in most quantiles, people perceived the environment as walkable if there were abundant green spaces and diverse alternative routes. Conversely, odors, smoke, hills, and stairs impeded walkability. This indicates that along with an objective walkability index, perceptions of the built environment play an important role in determining perceived neighborhood walkability. This implies that our results can help identify appropriate policies to promote walkability for citizens.