A Comparative Evaluation of Supervised Machine Learning Classification Techniques for Engineering Design Applications

Abstract

Supervised machine learning techniques have proven to be effective tools for engineering design exploration and optimization applications, in which they are especially useful for mapping promising or feasible regions of the design space. The design space mappings can be used to inform early-stage design exploration, provide reliability assessments, and aid convergence in multiobjective or multilevel problems that require collaborative design teams. However, the accuracy of the mappings can vary based on problem factors such as the number of design variables, presence of discrete variables, multimodality of the underlying response function, and amount of training data available. Additionally, there are several useful machine learning algorithms available, and each has its own set of algorithmic hyperparameters that significantly affect accuracy and computational expense. This work elucidates the use of machine learning for engineering design exploration and optimization problems by investigating the performance of popular classification algorithms on a variety of example engineering optimization problems. The results are synthesized into a set of observations to provide engineers with intuition for applying these techniques to their own problems in the future, as well as recommendations based on problem type to aid engineers in algorithm selection and utilization.

TopologyGAN: Topology Optimization Using Generative Adversarial Networks Based on Physical Fields Over the Initial Domain

“…Deep neural networks have proven to be effective at learning complex mappings between problem input variables and constraints, and target design objectives. Supervised machine learning techniques have proven to be effective for engineering design exploration and optimization, and for mapping out feasible regions of the design space [50]. Guo et al [34] propose a datadriven design representation where an augmented variational autoencoder is used to encode 2D topologies into a lower-dimensional latent space and to decode samples from this space back into 2D topologies.…”

Intelligent Academic Specialties Selection in Higher Education for Ukrainian Entrants: A Recommendation System

“…Other crucial studies describe the effectiveness of experiment series with learning resource data sets. The results of the experiment show that the proposed methods are able to give valuable recommendations for appropriate areas of student learning with significantly improved knowledge outcomes in terms of accuracy and efficiency compared to previous similar studies ( Sason and Kellerman 2021 ; Sharpe et al 2019 ; Sinclair et al 2019 ).…”

COVID-19 vaccine willingness and hesitancy among residents in Qatar: a quantitative analysis based on machine learning

“…Among the classification techniques used, multiple linear regression is a widely used model to find a relation between the predictors and a target variable, logistic regression uses categorical data from the survey, KNN classifies new data points based on the classes of its nearest neighbor. Other classification techniques were also used to compare its performance including support vector machines (SVM), stochastic gradient descent (SGD), decision trees, ensemble techniques, and multi-layer perceptron (Kotsiantis, 2007;Sharpe et al, 2019;Veena et al, 2018). Machine Learning can mainly be used for two types for inferential analysis viz.…”