Automated Hardware and Software System for Monitoring the Earth’s Magnetic Environment

Abstract

The continuous growth of geophysical observations requires adequate methods for their processing and analysis. This becomes one of the most important and widely discussed issues in the data science community. The system analysis methods and data mining techniques are able to sustain the solution of this problem. This paper presents an innovative holistic hardware/software system (HSS) developed for efficient management and intellectual analysis of geomagnetic data, registered by Russian geomagnetic observatories and international satellites. Geomagnetic observatories that comprise the International Real-time Magnetic Observatory Network (INTERMAGNET) produce preliminary (raw) and definitive (corrected) geomagnetic data of the highest quality. The designed system automates and accelerates routine production of definitive data from the preliminary magnetograms, obtained by Russian observatories, due to implemented algorithms that involve artificial intelligence elements. The HSS is the first system that provides sophisticated automatic detection and multi-criteria classification of extreme geomagnetic conditions, which may be hazardous for technological infrastructure and economic activity in Russia. It enables the online access to digital geomagnetic data, its processing results and modelling calculations along with their visualization on conventional and spherical screens. The concept of the presented system agrees with the accepted 'four Vs' paradigm of Big Data. The HSS can increase significantly the 'velocity' and 'veracity' features of the INTERMAGNET system. It also provides fusion of large sets of ground-based and satellite geomagnetic data, thus facilitating the 'volume' and 'variety' of handled data.

On the feasibility of routine baseline improvement in processing of geomagnetic observatory data

“…In the same pavilion, absolute observations of magnetic declination and inclination are carried out by operator 1-2 times per week, using the MinGeo 020B declinometer/ inclinometer (MinGeo, Hungary). The distance between the pavilions is about 25 m. The data from both magnetometers are continuously transmitted to the Magrec data logger (MinGeo, Hungary), where their temporal synchronization, min averaging by Gaussian filter, preliminary processing and further transmission to GC RAS are performed (Soloviev et al 2013;Gvishiani et al 2014Gvishiani et al , 2016a.…”

ULF wave power index for space weather and geophysical applications: A review

“…The methods to be used are based on the theory of discrete mathematical analysis (DMA). DMA has demonstrated considerable achievements in a number of geophysical and geodynamic applications, and started to be applied in geomagnetic studies: recognition of natural anomalies and estimation of their intensity using a unified scale in geoelectric and geomagnetic gravity records Gvishiani et al, 2014Gvishiani et al, , 2016Soloviev et al, 2013Soloviev et al, , 2016. Algorithmic DMA approach enabled one to recognize low-amplitude geomagnetic pulsations of different types and their time limits [Zelinskiy et al, 2014].…”

Geomagnetic activity during St. Patrick's Day storm inferred from global and local indicators

“…The DMA algorithms enable a morphological analysis of the time series, a detection of the formal anomalies and an estimation of the trends Soloviev et al, 2009Soloviev et al, , 2012aSoloviev et al, , 2012bSoloviev et al, , 2013Zelinskiy et al, 2014]. The DMA has been previously used for the geophysical monitoring [Agayan et al, 2016;Gvishiani et al, 2014Gvishiani et al, , 2016aGvishiani et al, , 2016b, Estimation of geomagnetic activity..., Annals of Geophysics, in press], for the data processing [Agayan et al, 2010[Agayan et al, , 2014Gvishiani et al, 2011], and for solution of various other problems which arise in the practice of geophysical data processing and interpretation.…”

“…At present twelve Russian observatories are able to provide the high world-quality measurements of the Earth's magnetic field which satisfy the requirements of INTERMAG-NET [Rasson, 2001]. The data are collected using a new geomagnetic Hardware and Software System (HSS) which was developed in 2014-2016 for the efficient and automated retrieval, storage, processing, and analysis for geomagnetic data [Gvishiani et al, 2014[Gvishiani et al, , 2016b. It provides the online access to geomagnetic data (both, the initial and processed ones), a sophisticated classification of the extreme geomagnetic events, detection of extreme geomagnetic conditions and visualization of the results.…”