Distributed Information System for Processing and Storage of Meteorological Data

Abstract

The following article features the results of developing distributed network storage of ground meteorological observation data. The data is represented with the national variant of international rapid transmission code of environment data from meteorological stations across the Russian Federation. They are available for researchers in both visual and common export formats. The design of the distributed network storage of meteorological data includes the following modules: dispatcher module (monitors calculation nodes, distributes data to nodes, processes client requests), client module (allows external researchers to access the meteorological data), terminal module (used to import new meteorological data), data processing and storage module (a node for distributed meteorological data storage, consists of two sub-modules for data processing and data storage respectively). The article displays the results of practical testing of the developed software. To simulate the cluster of informational and calculation servers in the pilot project, multithreading was used. Multithreading is supported by nearly every operational system for parallel data processing. The development tools chosen for the network storage allowed to design storage module interaction with the optimal efficiency, to ensure proper performance, stability and reliability of processing and managing large amounts of data. The obtained results allow using the designs for efficient management of meteorological surface observation data, for rapid data gathering, for systematization and storage of hydro-meteorological data in different alphanumeric codes and other related categories.

Resource management for meteorological service in cloud‐edge computing: A survey

“…Relate work Key point Meteorological big data service 18-25 18,19 Meteorological big data 20 Application of meteorological big data 21 A smart meteorological service model 22,23 Development of meteorological data for applications and modeling 24,25 Investigation on the meteorological big data services Meteorological scientific workflow 26-31 26,27 The development and application of workflow 28 The workflow scheduling issue 29 The meteorological workflow 30 Design and implementation of meteorological data workflows 31 The advantage of meteorological workflows Meteorological product service 32-36 32,33 The meteorological services 34 The development and creation of meteorological services 35 An evaluation of satellite/model proxies for hydrometeorology monitoring 36 The importance of meteorological services…”

Detection of an unauthorized wired connection to a local area network by solving telegraph equations system

“…(1) Special attention has been given to the cases of applying mathematical software packages aimed at problem-solving [3]. Thus, the communication line is modeled in COMSOL software environment.…”

A big data placement method using NSGA-III in meteorological cloud platform

“…The service it provides covers from data collection, retrieval to processing, analysis, and prediction, including forecasters' understanding of computer weather products, decisions, and visual submission of forecast conclusions, to form a complete system workflow [3]. It can effectively analyze meteorological conditions and carry out meteorological forecasting and disaster warning, which are closely related to people's production activities and daily life [4].…”