Interactive Visual Procedure using an extended FMEA and Mixed-Reality

Arevalo, Fernando; Sunaringtyas, Dimitri; Tito, Cristhian; Piolo, Christian Alison M.; Schwung, Andreas

doi:10.1109/icit45562.2020.9067296

Cited by 4 publications

(1 citation statement)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Therefore, this work aims to study the video-processing capabilities in Unity, even though this engine was originally developed to create and develop video games, and not for image processing. Currently there are several solutions to this interoperability problem, such as client-server architectures, subscribe/publish communication [14] or the development of native libraries for use without the need to adapt external communication [15]. Although they are only usable in the operating systems they were developed for, native plugins allow the generation of functionalities that cannot be realised in the C# language or through the Unity framework.…”

Section: Introductionmentioning

confidence: 99%

Video Processing from a Virtual Unmanned Aerial Vehicle: Comparing Two Approaches to Using OpenCV in Unity

Bustamante¹,

Belmonte

Herrera

et al. 2022

Applied Sciences

View full text Add to dashboard Cite

Virtual reality (VR) simulators enable the evaluation of engineering systems and robotic solutions in safe and realistic environments. To do so, VR simulators must run algorithms in real time to accurately recreate the expected behaviour of real-life processes. This work was aimed at determining a suitable configuration for processing images taken from a virtual unmanned aerial vehicle developed in Unity using OpenCV. To this end, it was focused on comparing two approaches to integrate video processing in order to avoid potential pitfalls such as delays and bottlenecks. The first approach used a dynamic link library (DLL) programmed in C++, and the second an external module programmed in Python. The native DLL ran internally on the same Unity thread, as opposed to the Python module that ran in parallel to the main process and communicated with Unity through the Message Queue Telemetry Transport (MQTT) protocol. Pre-transmission processing, data transmission and video processing were evaluated for a pair of typical image-processing tasks like colour and face detection. The analysis confirmed that running the Python module in parallel does not overload the main Unity thread and achieves better performance than the C++ plugin in real-time simulation.

show abstract

Section: Introductionmentioning

confidence: 99%