Efficient data management tools for the heterogeneous big data warehouse

Alekseev, A. A.; Osipova, V V; Ivanov, Maksim A.; Klimentov, A.; Grigorieva, N. V.; Nalamwar, Hitesh S.

doi:10.1134/s1547477116050022

Cited by 5 publications

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There is another method, it involves using the theory of database schema normalization and using it in schema design for MongoDB [15], but this approach does not take into account the relationships of "many", primary and foreign keys.…”

Section: Analysis Of Existing Methods and Algorithmsmentioning

confidence: 99%

“…A large number of authors devote their research papers to data migration methods between different data models [7][8][9][10][11][12][13][14][15]; most of these sources assume not only the physical migration of data between different data stores, but also the data schema re-designing procedure. These methods will be discussed and analyzed in more detail in the following parts.…”

Section: Literature Reviewmentioning

confidence: 99%

See 1 more Smart Citation

Research of Methods to Support Data Migration Between Relational and Document Data Storage Models

Peretiatko

Shirokopetleva

Lesna

2022

ITSSI

View full text Add to dashboard Cite

The subject matter of the article is heterogeneous model-inhomogeneous data migration between relational and document-oriented data storage models, existing strategies and methods to support such migrations, the use of relational algebra and set theory in the context of databases in building a new data migration algorithm. The goal of the work is to consider the features and procedure of data migration, explore methods to support data migration between relational and documentary data models, build a mathematical model and algorithm for data migration. The following methods were used: analysis and comparison of existing approaches to data migration, choice of strategy for further use in compiling the migration algorithm, mathematical modeling of the algorithm of heterogeneous model-inhomogeneous data migration, formalization of the data migration algorithm. The following tasks were solved in the article: consideration of the concept and types of data migration, justification for choosing a document-oriented data model as a target for data migration, analysis of existing literature sources on methods and strategies of heterogeneous model data migration from relational to document-oriented data model, highlighting advantages and disadvantages existing methods, choosing an approach to the formation of the data migration algorithm, compiling and describing a mathematical model of data migration using relational algebra and set theory, presentation of the data migration algorithm, which is based on the focus on data queries. The following results were obtained: the possibilities of relational algebra and set theory in the context of data models and queries are used, as well as in model redesign, the strategy of migration of data models is chosen, which provides relational and document-oriented data models, the algorithm of application of this method is described. Conclusions: because of the work, the main methods of migration support for different data storage models are analyzed, with the help of relational algebra, set theory a mathematical model is built, and an algorithm for transforming a relational data model into a document-oriented data model is taken into account. The obtained algorithm is suitable for use in real examples, and is the subject of further research and possible improvements, analysis of efficiency in comparison with other methods.

show abstract

Section: Analysis Of Existing Methods and Algorithmsmentioning

confidence: 99%