A Practical Utility-Based but Objective Approach to Model Selection for Scientific Applications in the Age of Big Data

Abstract

In many fields of science, various types of models are available to describe phenomena, observations and the results of experiments. In the last decades, given the enormous advances of information gathering technologies, also machine learning techniques have been systematically deployed to extract models from the large available databases. However, regardless of their origins, no universal criterion has been found so far to select the most appropriate model given the data. A unique solution is probably a chimera, particularly in applications involving complex systems. Consequently, in this work a utility-based approach is advocated. However, the solutions proposed are not purely subjective but all based on “objective” criteria, rooted in the properties of the data, to preserve generality and to allow comparative assessments of the results. Several methods have been developed and tested, to improve the discrimination capability of basic Bayesian and information theoretic criteria. Both the quality of the fits and the evaluation of model complexity are aspects addressed by the advances proposed. The competitive advantages of the individual alternatives, for both cross sectional data and time series, are clearly identified, together with their most appropriate fields of application. Particular attention has been paid to ensure that the proposed improvements of the criteria are easy to implement in practice, in both confirmatory and exploratory settings. Extensive numerical tests have been performed to support the conceptual and theoretical considerations.

Analysis of Weather Prediction, Resource Management, and Land Optimization on the Application of Big Data Analytics in Agricultural Land Utilization in Agrarian Areas of West Java

“…The collected data will undergo a rigorous analysis employing Structural Equation Modeling with Partial Least Squares (SEM-PLS) [22]. SEM-PLS is chosen for its suitability in handling complex models and relationships among multiple variables [23]. The analysis proceeds through the following steps: Model Specification: A theoretical model is constructed based on the literature review and research objectives [24].…”

Dampak Penggunaan Media Sosial terhadap Perilaku Konsumtif dan Persepsi Diri Remaja di Jakarta: Studi Mengenai Interaksi Online, Pengaruh Endorsement, dan Dampak Psikologis

“…SEM-PLS melibatkan beberapa langkah. Pertama, model teoritis didefinisikan berdasarkan tinjauan literatur, mengidentifikasi variabel laten dan indikatornya (Murari et al, 2023). Selanjutnya, preprocessing data dilakukan untuk memeriksa outlier dan data yang hilang, dan variabel distandarisasi untuk pembobotan yang sama (Narouie et al, 2023).…”