Much of the research on predictive maintenance has focused on statistical and machine learning techniques, while there has been significantly less focus on the human computer interaction or visualization aspects of PHM. Human computer interaction and visualization techniques can quickly help identify interesting data sub-domains, both time periods and sensors, provided the data can be queried, retrieved and displayed in a timely manner. Augmenting visualization and interaction with a visual, aggregative fleet-based query system adds a further dimension, highlighting the ability of the fleet to carry out its mission. In the age of big data, effectively visualizing data from an asset with a multitude of sensors can be difficult, and that difficulty is compounded as you add additional assets.
In this paper, we propose a scalable framework that is capable of visualizing past, current, and prognosticated health from the individual sensor up to the fleet or group level. In addition to viewing near real time sensor data, maintenance logs, fault information, and data aggregations will be merged with the sensor data to make the analysis and visualizations more valuable. This framework is scalable in regard to how much data can be collected, stored, and processed, as well as to the different organizational levels within a fleet of assets. The framework is built as a web-application primarily using the following visualizations: a collapsible tree graph for asset information; 2D charts for temporal sensor data, fault data, and maintenance data; and 3D digital twins of critical components.
The current dataset used to build and demonstrate the capability of the web-application has data from over 3000 vehicles and contains approximately 9TB of data. Vehicle information such as model, make, sub-component, and fleet organization are presented in a configurable, collapsible tree structure. This allows the user to visualize the fleet and to select the asset and sensor combinations needed to display the temporal sensor data that will answer the question at hand. Information regarding each vehicle’s health status is displayed then aggregated and displayed for each of the higher tree nodes. A 3D digital twin is also available to highlight sensor locations and current health status of the component. These component models can be viewed and manipulated with and without a virtual reality headset. As health status monitoring for asset subcomponents are developed, they can be added to the system, allowing for complete health status reporting.
