A comparative investigation of machine learning algorithms for predicting safety signs comprehension based on socio-demographic factors and cognitive sign features

Abstract

This study examines whether the socio-demographic factors and cognitive sign features can be used for envisaging safety signs comprehensibility using predictive machine learning (ML) techniques. This study will determine the role of different machine learning components such as feature selection and classification to determine suitable factors for safety construction signs comprehensibility. A total of 2310 participants were requested to guess the meaning of 20 construction safety signs (four items for each of the mandatory, prohibition, emergency, warning, and firefighting signs) using the open-ended method. Moreover, the participants were asked to rate the cognitive design features of each sign in terms of familiarity, concreteness, simplicity, meaningfulness, and semantic closeness on a 0–100 rating scale. Subsequently, all eight features (age, experience, education level, familiarity, concreteness, meaningfulness, semantic closeness, and simplicity) were used for classification. Furthermore, the 14 most popular supervised classifiers were implemented and evaluated for safety sign comprehensibility prediction using these eight features. Also, filter and wrapper methods were used as feature selection techniques. Results of feature selection techniques indicate that among the eight features considered in this study, familiarity, simplicity, and meaningfulness are found to be the most relevant and effective components in predicting the comprehensibility of selected safety signs. Further, when these three features are used for classification, the K-NN classifier achieves the highest classification accuracy of 94.369% followed by medium Gaussian SVM which achieves a classification accuracy of 76.075% under hold-out data division protocol. The machine learning (ML) technique was adopted as a promising approach to addressing the issue of comprehensibility, especially in terms of determining factors affecting the safety signs' comprehension. The cognitive sign features of familiarity, simplicity, and meaningfulness can provide useful information in terms of designing user-friendly safety signs.

Artificial Intelligence and Forensic Genetics: Current Applications and Future Perspectives

“…The F1 Score is used to provide two key performance indicators and it has a range of (0, 1). The indicators are the number of examples that the classifier properly classifies (its precision) and the number of instances that it does not miss (its robustness) [64,65].…”

Comprehension of City Map Pictograms Designed for Specific Tourists’ Needs

“…Please enter your response." The answer was categorized correct if the participant's interpretation aligned with the intended meaning of the pictogram [36]. Otherwise, it was categorized as incorrect.…”

Correcting spelling mistakes in Persian texts with rules and deep learning methods

“…Text-based applications are numerous and include information retrieval 4-7 , document classification and sentiment analysis [8][9][10][11][12] , keyword extraction 13 , word embedding 14 , handwriting recognition 15 , etc. In the fields of education and medicine, deep learning is of great interest to researchers due to its capabilities and the creation of suitable platforms [16][17][18] .Spelling is a component of word processing that checks the correctness of words and makes necessary corrections if there are errors. This task is one of the simplest applications that involves text processing.…”

“…Text-based applications are numerous and include information retrieval 4-7 , document classification and sentiment analysis [8][9][10][11][12] , keyword extraction 13 , word embedding 14 , handwriting recognition 15 , etc. In the fields of education and medicine, deep learning is of great interest to researchers due to its capabilities and the creation of suitable platforms [16][17][18] .…”