The purpose of this study is to analyze the usefulness of 3D immersive stereoscopic virtual reality technology in applications that provide tactile sensations. Diverse experiments show that the haptic 3D visualization method presented in a 3D stereoscopic space using headsets is more intuitive, accurate and immersive than the haptic 3D visualization method displayed in 3D flat displays. In particular, the intuitiveness has been significantly improved in a stereoscopic 3D visualization rather than flat 3D visualization. In spite of the general superiority of the stereoscopic 3D visualization, it is mentionable that the precise operation performance has not been greatly improved in the elaborate object movements. It means that users can recognize and manipulate the position of objects more quickly in 3D stereoscopic immersive VR environments, however, the precise operation does not benefit greatly in the 3D stereoscopic visualization. Note that the degree of game immersion is remarkably augmented in the case of using 3D stereoscopic visualization.

The aim of this study is to develop an intelligent haptic virtual simulation for suture surgery, enabled with an AI assistant. This haptic VR suture simulation mainly composed of three parts: visuo-haptic rendering for surgery, replica training for surgery, and AI assistant for surgery. In the simulation, a trainee surgeon can practice the suturing procedure using tactile touches in the stereoscopic 3D virtual environment. The simulation adopts a "precise haptic collision detection method using subdivision surface and sphere clustering" developed in the previous studies of authors. In addition, an expert surgeon's suture operations can be replicated to the medical trainee's simulation to experience it as it is. This method has the advantage of reproducing the experience of the expert's ideal movements of surgical procedures. The data recording of the skilled surgeon's motions and operations are normalized into a form suitable for AI learning. The AI assistant distinguishes five typical types of suture surgery methods and learns the proper methods for various wounds using deep learning techniques, then it suggests the most appropriate suture method. The suture simulation can reduce the cost and time required for surgical training and eventually provide safe and accurate physical surgery.

No abstract