Dental Training System using Multi-modal Interface

Abstract

We present a dental training system through multi-modal interface such as visual, auditory and haptic sensations. The system allows dental students to learn dental procedures and handling dental instruments with realistic feelings and evaluate their performance. To implement this system, it requires stable and fast haptic rendering algorithm, visual model deformation techniques on the virtual tooth being deformed, and sound rendering to simulate contact sound between the virtual tool and tooth. We enhance previous volume-based haptic modeling systems for haptic dental simulation. Collision detection and force computation are implemented on an offset surface rather than the implicit surface to simulate physical interactions between the virtual dental tool and tooth model. To bridge the gap between fast haptic process (1 KHz) and much slower visual update frequency (~30Hz), the system generates intermediate implicit surfaces between two consecutive physical models being deformed resulting in smooth force rendering. The volumetric tooth model is visualized as a geometric model which is adaptively polygonized according to the surface complexity. Volumetric material properties are used to simulate the resistance and texture information depending on anatomical tissues. Finally, we developed a multi-modal workbench to register visual, auditory and haptic sensations so that the user see, hear, and feel the virtual environment in the same space.

Haptic augmented reality dental trainer with automatic performance assessment

“…The limitations of this approach include a lack of real-world challenging cases, unavailability of expert supervision, and the subjective manner of surgical skills assessment based on the number of errors and task completion time. Recently, haptic VR simulators for dental surgery have been introduced [1,3]. The advantages of these simulators are that the students are able to practice procedures as many times as they want at no incremental cost and that the training can take place anywhere.…”

Development of a Dental Training System Based on Point-based Models

“…But their systems only focus on haptic contact simulation. Kim et al [16] presented a dental training system through a multimodel interface using visual, auditory, and haptic sensations. And their system is developed based on a voxel model like FreeForm [17].…”

An augmented reality based teeth shade matching system

“…Only the ShadeVision system supports a virtual try-in by merging the picture of finished denture into the oral cavity image. The try-in step, which proceeds after the finish of the restoration, is helpful to verify the correctness of the shade matching, but can not reduce the labor and material wasted by the incorrect shade matching result [Joiner 2004;Kim et al 2005]. …”