Hills alter wind properties not only by accelerating the wind flow but also by changing the flow direction. Therefore, the wind profile near mountainous terrain continuously exhibits both wind speed and wind direction variation along with the vertical height, and is generally referred to as a twisted wind profile (TWP). The aerodynamic properties of the tall building exposed to TWP are significantly different from those exposed to a conventional wind profile (CWP) and thus generate the twisted-wind effect. The spatial–temporal aerodynamic feature of a tall building under unsteady wind is highly complicated, and the associated flow field is a random and obscure high-dimensional dynamic system. To elucidate the fundamental mechanism involved in TWP, principal orthogonal analysis (POD) is employed to identify the pressure and flow patterns. Moreover, the extracted modal features can be used to physically interpret the coherent structure and dynamical patterns hidden in the surface pressure field or the turbulent flow field. This mode interpretation of aerodynamic characteristics of tall building provides a better understanding of the underlying mechanism of the twisted-wind effect.