Understanding Spatial Relationships in US: A Computer-based Training Tool That Utilizes Inexpensive Off-the-Shelf Game Controllers

Abstract

The authors present a simulation-based ultrasonographic (US) training tool that can help improve the understanding of spatial relationships in US. Use of a game controller to simulate a US probe allows examination of different virtual three-dimensional (3D) objects. These 3D objects are either completely artificial simple geometric objects (eg, spheres, tubes, and ellipsoids, or more complex combinations thereof) or derived from photographed gross anatomic data (eg, the Visible Human dataset [U.S. National Library of Medicine]) or clinical computed tomographic (CT) data. The virtual US probe allows infinitely variable real-time positioning of a "slice" that is displayed as a two-dimensional (2D) cross-sectional image and as part of a 3D view. Combining the 2D and 3D views helps elucidate the spatial relationships between a 3D object and derived 2D images. This training tool provides reliable real-time interactivity and is widely available and easily affordable, since it utilizes standard personal computer technology and off-the-shelf gaming hardware. For instance, it can be used at home by medical students or residents as a complement to conventional US training. In the future, this system could be adapted to support training for US-guided needle biopsy, with use of a second game controller to control the biopsy needle. Furthermore, it could be used as a more general interactive visualization tool for the evaluation of clinical 3D CT and magnetic resonance imaging data, allowing efficient and intuitive real-time creation of oblique multiplanar reformatted images.

Virtual Reality in Medical Students’ Education: Scoping Review

“…The delivery devices used include the use of screens in most of the studies (100/114, 87.7%) [ 8 , 9 , 14 , 35 - 47 , 49 - 51 , 53 - 56 , 58 , 59 , 61 - 69 , 71 , 73 - 79 , 81 , 83 - 86 , 88 - 91 , 93 - 95 , 97 - 104 , 106 - 117 , 119 - 129 , 131 - 138 , 140 - 144 , 146 , 147 , 151 , 156 - 159 , 161 - 166 , 168 , 170 , 171 ], headset (13/114, 11.4%) [ 48 , 57 , 70 , 80 , 82 , 87 , 92 , 95 , 96 , 105 , 118 , 145 , 153 , 155 , 167 , 172 ], and 3D projector with stereoscopic glasses (1/114, 0.9%) [ 72 ] (Figure S2 in Multimedia Appendix 3 ).…”

“…Most of the studies included modalities that were of high interactivity (79/114, 69.3%) [ 35 - 37 , 42 , 43 , 45 - 51 , 55 - 57 , 59 , 66 , 67 , 70 , 73 - 75 , 79 , 81 - 84 , 86 - 91 , 93 , 94 , 96 , 98 - 100 , 102 , 103 , 105 - 113 , 115 , 116 , 118 - 129 , 131 - 135 , 137 , 143 , 145 - 147 , 156 , 168 , 171 , 173 , 174 ], whereas 16.7% (19/114) of the studies [ 9 , 38 - 41 , 62 - 64 , 68 , 69 , 76 - 78 , 97 , 104 , 140 , 141 , 151 , 153 , 159 , 161 , 162 , 165 , 169 ] included modalities that were of moderate interactivity and 14% (16/114) of the studies included modalities that were of low interactivity [ 8 , 14 …”

Anatomy Studio: A tool for virtual dissection through augmented 3D reconstruction

“…The authors employed a touch-sensitive surface to allow radiologists to navigate through volumetric data sets. Lopes et al [27] explored the potential of immersion and freedom of movement afforded by VR to perform CT Colonograpy reading, allowing users to [28,29,30]. Immersive solutions usually place anatomical representations within a 3D virtual space [30], similarly 8 to plaster models used in the anatomical theater, or consider 9 virtual representations of the dissection table [28,29] but of-10 ten require dedicated and expensive hardware.…”

Accessible Personal Ultrasound Training Simulator

“…8.44 ± 1.33 [7][8][9][10] was the most commonly cited barrier to the use of sonography, followed by cost (50%), difficulty maintaining ultrasound machines (47%), and lack of equipment (46%). 23 In this survey, 74% of respondents wished to have further training in ultrasound, and 82% were interested in distance learning.…”

“…Further, the cost of ultrasound simulators may make it inaccessible in many resource‐limited settings, such as low and middle‐income countries. More recently, efforts have been made to create inexpensive simulators using off‐the‐shelf game controllers and low‐cost optical tracking systems . While these are a step forward, the need to use any hardware that is not already available or readily accessible remains a potential barrier to the widespread use of ultrasound simulators as an effective teaching tool.…”