Mixed reality ultrasound guidance system: a case study in system development and a cautionary tale

Ameri, Golafsoun; Baxter, Jamie; Bainbridge, Daniel; Peters, Terry M.; Chen, Elvis C. S.

doi:10.1007/s11548-017-1665-7

Cited by 24 publications

(17 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Also, the resolution is very low (1268 × 720) and the integration of artificial intelligence does not make any difference. References 39,41,43,44,47,48,79,and 86‐89 used different screens, PCs, or monitors to view the data along with other devices like iPad, projectors, and camera. Different from all these, Zhao et al 9 used a glasses‐free polyhedron‐shaped display device for telesurgical guidance.…”

Section: Discussionmentioning

confidence: 99%

A recent review and a taxonomy for hard and soft tissue visualization‐based mixed reality

Tuladhar

AlSallami

Alsadoon

et al. 2020

Robotics Computer Surgery

View full text Add to dashboard Cite

Background: Mixed reality (MR) visualization is gaining popularity in image-guided surgery (IGS) systems, especially for hard and soft tissue surgeries. However, a few MR systems are implemented in real time. Some factors are limiting MR technology and creating a difficulty in setting up and evaluating the MR system in real environments. Some of these factors include: the end users are not considered, the limitations in the operating room, and the medical images are not fully unified into the operating interventions. Methodology: The purpose of this article is to use Data, Visualization processing, and View (DVV) taxonomy to evaluate the current MR systems. DVV includes all the components required to be considered and validated for the MR used in hard and soft tissue surgeries. This taxonomy helps the developers and end users like researchers and surgeons to enhance MR system for the surgical field. Results: We evaluated, validated, and verified the taxonomy based on system comparison, completeness, and acceptance criteria. Around 24 state-of-the-art solutions that are picked relate to MR visualization, which is then used to demonstrate and validate this taxonomy. The results showed that most of the findings are evaluated and others are validated. Conclusion: The DVV taxonomy acts as a great resource for MR visualization in IGS. State-of-the-art solutions are classified, evaluated, validated, and verified to elaborate the process of MR visualization during surgery. The DVV taxonomy provides the benefits to the end users and future improvements in MR.

show abstract

Section: Discussionmentioning

confidence: 99%

A recent review and a taxonomy for hard and soft tissue visualization‐based mixed reality

Tuladhar

AlSallami

Alsadoon

et al. 2020

Robotics Computer Surgery

View full text Add to dashboard Cite

show abstract

“…In this article [13], the use of mixed reality for the development of an Augmented Paper Map (APM) system was observed, the two authors who developed this article report Scrum, as the methodology that helped them to achieve the objectives of their article, explaining a bit about the roles and artifacts that were useful for the application of this methodology, they also express the design philosophy they used, which is that the design is user-centered, so that in this way the final product complies with the needs of these (Users), and thus achieve the greatest satisfaction with the minimum effort on the part of the user. It also tells us about the activities that they had to develop and carry out during the course of the article, as well as the exploration, analysis and evaluations that they had to develop for the development of the Augmented Paper Map (APM) system.…”

Section: B Related Workmentioning

confidence: 97%

Augmented Reality: Prototype for the Teaching-Learning Process in Peru

Morales¹,

Andrade–Arenas²,

Delgado³

et al. 2022

IJACSA

View full text Add to dashboard Cite

In recent years, augmented reality is playing an important role in the world of mobile technology, since it is a way to facilitate the teaching-learning processes, this easy teachinglearning process generates a great contribution in companies, either creating opportunities or changing the way in which companies approach and interact with their end customers, this can mean a remarkable growth of the organization, that is why in this work an augmented reality prototype has been made using the methodology Scrum at the University of Sciences and Humanities of Lima-Peru, but with a focus on the nursing career. Knowing that the problem is the limited learning that students acquire in the classrooms, for which, we want to make use of augmented reality, so that this improves the form of education that is provided to university students. The result obtained, from developing the case study, was an augmented reality prototype for the improvement of education at the University of Sciences and Humanities of Lima-Peru, which shows a virtual model (it depends on the image shown), able to interact with the user, making it attractive and motivating for the student, this prototype was achieved, using Unity (3D development platform, Vuforia (augmented reality software development kit), Microsoft Visual Studio (integrated development environment), the Scrum Methodology (Scrum Pillars, Product Backlog, Product Backlog Estimation, Speed, Backlog Prioritization and Sprint Planning) and the C# Language (C Sharp).

show abstract

“…Previous studies showed that the fidelity of a VR system is associated with the number of sensory modalities it stimulates [7]. For instances, many studies have demonstrated that multimodal sensory cues-haptic, auditory, and visual (HAV)-enhances experience, motor skill performance, and learning of the VR users [8], [9], [10] compared to bimodal (audio and visual-AV) or unimodal VR system and is as effective as live training for motor skill learning [11], [12]. Nevertheless, simulating haptic interactions is challenging.…”

Section: Introductionmentioning

confidence: 99%

A Physics-based Virtual Reality System Design and Evaluation by Simulating Human-Robot Collaboration

Chowdhury¹,

Mubarrat²,

Fernandes³

2022

Preprint

View full text Add to dashboard Cite

Recent advancements in VR technology facilitate tracking real-world objects and users' movements in the virtual environment (VE) and inspire researchers to develop a physics-based haptic system (i.e., real object haptics) instead of computer-generated haptic feedback. However, there is limited research on the efficacy of such VR systems in enhancing operators’ sensorimotor learning for tasks that require high motor and physical demands. Therefore, this study aimed to design and evaluate the efficacy of a physics-based virtual reality (VR) system that provides users realistic cutaneous and kinesthetic haptic feedback. We designed a physics-based VR system, named PhyVirtual, and simulated human-robot collaborative (HRC) sequential pick-and-place lifting tasks in the VE. Participants performed the same tasks in the real environment (RE) with human-human collaboration instead of human-robot collaboration. We used a custom-designed questionnaire, the NASA-TLX, and electromyography activities from biceps, middle and anterior deltoid muscles to determine user experience, workload, and neuromuscular dynamics, respectively. Overall, the majority of responses (>65%) demonstrated that the system is easy-to-use, easy-to-learn, and effective in improving motor skill performance. While compared to tasks performed in the RE, the PhyVirtual system placed significantly lower physical demand (124.90%; p < 0.05) on the user. The electromyography data exhibited similar trends (p > 0.05; r > 0.89) for both environments. These results show that the PhyVirtual system is an effective tool to simulate safe human-robot collaboration commonly seen in many modern warehousing settings. Moreover, it can be used as a viable replacement for live sensorimotor training in a wide range of fields.

show abstract

Mixed reality ultrasound guidance system: a case study in system development and a cautionary tale

Cited by 24 publications

References 43 publications

A recent review and a taxonomy for hard and soft tissue visualization‐based mixed reality

A recent review and a taxonomy for hard and soft tissue visualization‐based mixed reality

Augmented Reality: Prototype for the Teaching-Learning Process in Peru

A Physics-based Virtual Reality System Design and Evaluation by Simulating Human-Robot Collaboration

Contact Info

Product

Resources

About