Subjectively Measured Streetscape Qualities for Shanghai with Large-Scale Application of Computer Vision and Machine Learning

Abstract

Recently, many new studies emerged to apply computer vision (CV) to street view imagery (SVI) dataset to objectively extract the view indices of various streetscape features such as trees to proxy urban scene qualities. However, human perceptions (e.g., imageability) have a subtle relationship to visual elements which cannot be fully captured using view indices. Conversely, subjective measures using survey and interview data explain more human behaviors. However, the effectiveness of integrating subjective measures with SVI dataset has been less discussed. To address this, we integrated crowdsourcing, CV, and machine learning (ML) to subjectively measure four important perceptions suggested by classical urban design theory. We first collected experts’ rating on sample SVIs regarding the four qualities which became the training labels. CV segmentation was applied to SVI samples extracting streetscape view indices as the explanatory variables. We then trained ML models and achieved high accuracy in predicting the scores. We found a strong correlation between predicted complexity score and the density of urban amenities and services Point of Interests (POI), which validates the effectiveness of subjective measures. In addition, to test the generalizability of the proposed framework as well as to inform urban renewal strategies, we compared the measured qualities in Pudong to other five renowned urban cores worldwide. Rather than predicting perceptual scores directly from generic image features using convolution neural network, our approach follows what urban design theory suggested and confirms various streetscape features affecting multi-dimensional human perceptions. Therefore, its result provides more interpretable and actionable implications for policymakers and city planners.

Associations between Street-View Perceptions and Housing Prices: Subjective vs. Objective Measures Using Computer Vision and Machine Learning Techniques

“…Although it is intuitive for most developers to believe the value of green spaces and pleasant neighborhood environment, compared to investments in apartment building constructions, inputs into engaging and facilitating beatifying streets are still not sufficient. While the implicit return from investing in streetscapes on improving property values is noneligible [32,36,96], our finding suggests that the urban design process for deciding the streetscape could be more participatory, allowing different stakeholders to contribute to a better street environment [30]. On the other hand, our findings asserted that while real-estate developers have already benefitted from the surrounding street environment, they should have taken more responsibility such as contributing to maintaining the street greenery [21,25].…”

XR4DRAMA a knowledge-based system for disaster management and media planning

“…The visual analysis component consists of several machine learning (ML) models either trained from scratch or fine-tuned from other efforts. The model performing semantic segmentation (Qiu et al, 2021) on images was trained to extract semantic labels and percentages per pixel on images while the Verge classifier (Andreadis et al, 2020) was deployed to classify the images (or video frames) to one or more classes based on context.…”

Visual Engagement: Quantifying Campus Experiences in Urban Open Spaces Using a Computer Vision Model

“…The application of computer vision technologies in urban management represents a progression in employing image-based AI for data collection [4]. However, these objective approaches potentially overlook the complexities of human perceptions [5].…”

“…Subjective measures, derived from interviews and surveys, offer deeper insights into human behavior by considering the cognitive mapping of environments [2]. However, traditional methods for collecting perception data often lack consistency, and reliability, are time-consuming, expensive, and challenging to interpret [5].…”