Spatiotemporal video-domain high-fidelity simulation and realistic visualization of full-field dynamic responses of structures by a combination of high-spatial-resolution modal model and video motion manipulations

Abstract

SummaryStructures with complex geometries, material properties, and boundary conditions exhibit spatially local dynamic behaviors. A high-spatial-resolution model of the structure is thus required for high-fidelity analysis, assessment, and prediction of the dynamic phenomena of the structure. The traditional approach is to build a highly refined finite element computer model for simulating and analyzing the structural dynamic phenomena based on detailed knowledge and explicit modeling of the structural physics such as geometries, materials properties, and boundary conditions. These physics information of the structure may not be available or accurately modeled in many cases, however. In addition, the simulation on the high-spatial-resolution structural model, with a massive number of degrees of freedom and system parameters, is computationally demanding. This study, on a proof-of-principle basis, proposes a novel alternative approach for spatiotemporal video-domain high-fidelity simulation and realistic visualization of full-field structural dynamics by an innovative combination of the fundamentals of structural dynamic modeling and the advanced video motion manipulation techniques.Specifically, a low-modal-dimensional yet high-spatial (pixel)-resolution (as many spatial points as the pixel number on the structure in the video frame) modal model is established in the spatiotemporal video domain with full-field modal parameters first estimated from line-of-sight video measurements of the operating structure. Then in order to simulate new dynamic response of the structure subject to a new force, the force is projected onto each modal domain, and the modal response is computed by solving each individual single-degree-of-freedom system in the modal domain. The simulated modal responses are then synthesized by the full-field mode shapes using modal superposition to obtain the simulated full-field structural dynamic response. Finally, the simulated structural dynamic response is embedded into the original video, replacing the original motion of the video, thus generating a new photo-realistic, physically accurate video that enables a --

Novel Approach to Extract Dense Full-Field Dynamic Parameters of Large-Scale Bridges Using Spatial Sequence Video

“…Li et al (2011) proposed a structural damage identification method based on fractals, which requires dense vibration mode data. Furthermore, Yang et al (2018b) used a fractal method to identify structural damage based on computer vision to obtain dense vibration mode data.…”

Damage localization and quantification in gusset plates: A battery-free sensing approach

“…Shahidi et al presented two image‐based compressive sensing approaches to detect and localize multiple structural damages. Dynamic vision sensors were developed to detect damage using full‐field, high spatial resolution model shape extracted from videos of operating structures . Yang et al and Roeder et al conducted spatial fractal dimension analysis on the full‐field mode shape of damaged structures to detect damage‐induced irregularity.…”

“…Dynamic vision sensors were developed to detect damage using full‐field, high spatial resolution model shape extracted from videos of operating structures . Yang et al and Roeder et al conducted spatial fractal dimension analysis on the full‐field mode shape of damaged structures to detect damage‐induced irregularity. Arguably, vison‐based sensing technology is essentially based on processing and analyzing huge amount of collected images captured by cameras.…”

Compressed sensing for OMA using full-field vibration images

“…Other than conventional accelerometer or strain gauge measurement, non-destructive acoustic [4] and non-contact vision-based [5,6] measuring methods are also being adopted. Yang et al [7] proposed a highfidelity simulation and visualisation method for full-field dynamic structural responses based on phase-based motion magnification (Wadhwa et al [8]) as an alternative to finite element analysis. Along with the expanding application of video-based monitoring, image transmission or storage plays an important role in realising the implementation of state-of-art techniques in industry.…”

“…One problem with this is that k is usually unknown without first determining all the coefficients and then deciding which ones should be retained -this is the adaptive approach (as applied in the SD method). An important aspect of CS is that it is non-adaptive and does not require the explicit solution of the underdetermined problem described in (7).…”