A Comparison of Neural Network and Expert Systems Algorithms with Common Multivariate Procedures for Analysis of Social Science Data

Abstract

New computer techniques for data analysis, notably the algorithms associated with neural networks and with expert systems, have not caught on to a significant extent in social science. To appraise these developments, an empirical assessment is conducted in which expert systems and neural network approaches are compared with multiple linear regression, logistic regression, effects analysis, path analysis, and discriminant analysis. A simple method of partitioning neural network output layer connections in terms of input nodes (corresponding to independent variables) is also presented, allowing neural net analysis for modeling as well as classification purposes. It is concluded that back-propagation (neural networks) is more effective than other procedures, sometimes strikingly so, in correctly classifying the dependent, even when the amount of noise in the model is high. Back-propagation was of less help, however, in causal inference. None of the techniques performed well by this important criterion. The ID3 algorithm is found to provide a useful mode of knowledge representation quite different from other procedures. While this may be preferred by some analysts for certain types of research, ID3 is not consistently superior to procedures in the multiple linear general model (MLGH) family in terms of effectiveness, either for classification or for causal inference.

Search for WZ+ZZ Production with Missing Transverse Energy and b Jets at CDF

“…Garson's algorithm [75]. For our NNs we found this simplified version to be in good agreement with the full Garson algorithm.…”

Bankruptcy visualization and prediction using neural networks: A study of U.S. commercial banks

“…The complexity of the mathematical and algorithmic elements makes the flow of information through the net difficult to understand. One of the most widely used methods to cope with this criticism is the so-called sensitivity analysis (Garson, 1991;Hunter, Kennedy, Henry & Ferguson, 2000;Rambhia, Glenny & Hwang, 1994;Zurada, Malinowski & Cloete, 1994).…”

Model selection approaches for non-linear system identification: a review

“…More recently, applications in newer areas are being reported including communication networks (Chen, Gibson, Cowan, and Grant 1991;Clarkson 1999), biomedical, biochemical and life systems (Ma and Wang 2000;Gamero, Armentano, Barra, Simon, and, Levenson 2001;Sargantanis and Karim 2004;Karayiannis et al 2006), as well as other sectors other than engineering, such as financial (Marose 1990), social (Garson 1991), health care and medical (Dybowski and Gant 2001). Space prevents a comprehensive survey of such a vast literature survey and so only a few detailed examples are included here.…”