This paper provides a review of the application equipment in multi‐user collaborative design, and analyzes and prospects by reviewing the existing interaction models in the HCI field and the CSCW field. The collaborative interaction of multiple users in the augmented reality environment has become more prominent in academic research and engineering applications. Augmented reality technology has been successfully applied in medical, education, entertainment, simulation design and other related fields. However, as far as we know, the current research on interaction in augmented reality mainly focuses on the three aspects of physical interaction, three‐dimensional interaction and mobile interaction, but there is less research about multi‐user collaborative interaction. Therefore, this article conducts a comprehensive review of the research in this field from 1998 to 2021. As more and more users are accepting augmented reality as an interactive technology, the demands of collaborative task and technology demand have been increasing among multi‐users. However, there are still some problems in existing research such as the immaturity of the collaborative application of augmented reality and the lack of interactive models for guiding the design of collaborative applications in the augmented reality environment. Therefore, it is necessary to analyze an effective collaborative interaction model to promote the realization of a prototype interaction system, so as to promote the application of augmented reality technology in collaborative interaction.

The ORB-SLAM3 algorithm operates around the matching relationship of feature points. Only when the extracted matching points are sufficient and accurate can the camera pose and the world coordinates of map points be calculated correctly and quickly, then sufficient effective data can be extracted in the environment. It is particularly important. ORB-SLAM3 can extract images up to 30ms/frame. The real-time performance on the PC is very good, but the performance on the embedded side is not good enough. This paper optimizes the problems existing in the feature point extraction and map construction of the monocular ORB-SLAM3 system to improve the illumination invariance, uniformity and human-computer interaction of the algorithm, improve the threshold and improve the extraction accuracy with the help of the IMU sensor. The radius algorithm and YOLOv7 algorithm filter the best points to improve the matching accuracy of feature points. In order to achieve the final effect of augmented reality, a set of augmented reality development system was constructed based on the Unity3D cross-platform game engine. The system guarantees synchronous rendering, particle effects, background video rendering and real-time shadow rendering. At the same time, the interface is packaged and can be connected to the perception positioning algorithm library under different platforms. The augmented reality system is completed by using HoloLens. The system can autonomously detect the environment, Track and record the position of relevant objects in the environment, and at the same time use the visual SLAM perception positioning algorithm to ensure the safety of users, providing a new idea for the application of augmented reality devices.