The prefabricated components are an important aspect of prefabricated constructions. Based on three possible collision situations when the fabricated component is being lifted during the installation phase, the aim of this study is to investigate how to prevent effective collision between the hoist and the barrier, and establish the standardized operation process (SOP) of using the Inertial Measurement Unit (IMU) to detect the hoisting collision of fabricated building components. The (IMU) technology is used in the collection of lifting activities data. The hoisting activity will be divided into four situations: classification and recognition of stationary, ascending, advancing, and descending of components; use of the K-Nearest Neighbor (KNN) algorithm and the Random Forest (RF) algorithm for data processing to recognize the hoisting activities of assembled components; construction of the hoisting activity recognition model; determination of the best recognition position of the IMU; further collision analysis based on the recognition of the hoisting of assembled components. The collision is divided into direct collision, sudden stop, and detour in a specific space from obstacles. Image analysis of the three types of collision activities will be carried out to help perceive lifting activities in advance and reduce loss resulting from collisions caused by components. According to the systematic research and discussion of hoisting activity recognition and collision behavior, it provides a reasonable basis and ideas for solving hoisting collisions in prefabricated buildings and aids in the use of inertial sensors in construction to provide assistance for construction automation.