Investigation of Distributed Matrix Factorisation Efficiency in the Industrial Systems

Abstract

The processing of big data is an exceedingly urgent challenge in the functioning of modern information systems. The latest information technologies must be employed to collect, store, and analyze vast amounts of information. Intelligent data processing systems were implemented in numerous fields, particularly in the industry. Smart industrial systems also utilize data from various devices, enabling automated management processes and network component analysis. A prime example of an intelligent industrial system is the smart grid, which efficiently distributes electricity to users by considering demand, network parameters, load, etc. Processing large amounts of information necessitates the use of machine learning methods and mathematical data analysis. Matrix factorization serves as an exemplary technique for transforming information into a more convenient form for further processing, establishing relationships between elements, and optimizing outcomes. In particular, the SVD (Singular Value Decomposition) and Funk-SVD algorithms are employed to address big data processing challenges, and they were discussed in this work. The key features of processing large data volumes in industrial smart grid systems were analyzed in the paper. The advantages of distributed computing for more efficient information analysis were identified. The recommendation algorithms that enable faster and more accurate processing of extensive data were explored in the study. Specifically, the SVD and Funk-SVD algorithms, used in recommendation systems for large data processing, were examined. A method of distributed matrix factorization to provide recommendations to smart grid system users was proposed in the paper. This approach involves the exchange of public data between devices and the local processing of private data. The advantages of this distributed model include flexibility in adjusting parameters, improved calculation accuracy through result exchange between nodes, high data processing speed, and scalability were identified. The conclusion that the proposed method can be effectively used in recommendation systems within the smart grid context, enhancing automated management processes and resource distribution was exclaimed.