Data Imputation of Missing Values From Marine Systems Sensor Data. Evaluation, Visualisation, and Sensor Failure Detection

Velasco-Gallego, Christian; Lazakis, Iraklis

doi:10.3940/rina.miet.2021.03

Cited by 1 publication

(1 citation statement)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the context of data analysis, data imputation is a pre-processing stage aiming to estimate pinpointed missing values in order to avoid the under-utilization of data. Hence, if missing values are not tackled, the results obtained may be unreliable and inaccurate, leading to biases in further phases due to inadequate models implemented in the decision-making process [4]. Although time series' data imputation is a well-researched subject, the choice of the best missing data handling technique is still a challenging issue.…”

Section: Introductionmentioning

confidence: 99%

Conducting Vessel Data Imputation Method Selection Based on Dataset Characteristics

Fatyanosa,

Firdausanti,

Soto

et al. 2023

IOP Conf. Ser.: Earth Environ. Sci.

View full text Add to dashboard Cite

Time series datasets collected from marine sensors inevitably undergo missing data problems. This cause unreliable sensor data to assist the decision-making process. Many methods are offered to impute missing values. However, selecting the best imputation method is not a trivial task, as it usually requires domain expertise and several trial-and-error iterations. Furthermore, when imputations are carried out in a careless way, it generates a high error factor that can lead stakeholders to wrong assumptions. This paper provides a systematic approach that is able to extract characteristics of underlying data and, based on it, recommends the less error-prone imputation method. We evaluate our proposed method using nine real-world vessel datasets. In total, we generated 3859 data samples consisting of 17 inputs and 1 target feature. Experimental results show that the proposed approach is capable of obtaining a weighted F1-Score of 92.6%. Additionally, when compared with the application of careless selected imputation methods, our work is able to gain up to 86% on the average imputation score, with the worst case gain being of 5%. We empirically demonstrate that the proposed approach is efficient when selecting the best imputation methods.

show abstract

Section: Introductionmentioning

confidence: 99%