Query Languages for Polystore Databases for Large Scientific Data Archives

Poudel, Manoj; Shrestha, Shashank; Sarode, Rashmi P.; Chu, Wanming; Bhalla, Subhash

doi:10.1109/confluence.2019.8776972

Cited by 2 publications

(2 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To store and execute queries, these agents can serve as intermediaries (mediators) between them. FDBS data are stored in a relational database, which is a single data model supported by the system [67].…”

Section: Challenge Of the Future Management In Astronomical Data Arch...mentioning

confidence: 99%

A Survey of Big Data Archives in Time-Domain Astronomy

et al. 2022

Self Cite

View full text Add to dashboard Cite

The rise of big data has resulted in the proliferation of numerous heterogeneous data stores. Even though multiple models are used for integrating these data, combining such huge amounts of data into a single model remains challenging. There is a need in the database management archives to manage such huge volumes of data without any particular structure which comes from unconnected and unrelated sources. These data are growing in size and thus demand special attention. The speed with which these data are growing as well as the varied data types involved and stored in scientific archives is posing further challenges. Astronomy is also increasingly becoming a science which is now based on a lot of data processing and involves assorted data. These data are now stored in domain-specific archives. Many astronomical studies are producing large-scale archives of data and these archives are then published in the form of data repositories. These mainly consist of images and text without any structure in addition to data with some structure such as relations with key values. When the archives are published as remote data repositories, it is challenging work to organize the data against their increased diversity and to meet the information demands of users. To address this problem, polystore systems present a new model of data integration and have been proposed to access unrelated data repositories using an uniform single query language. This article highlights the polystore system for integrating large-scale heterogeneous data in the astronomy domain.

show abstract

Section: Challenge Of the Future Management In Astronomical Data Arch...mentioning

confidence: 99%

A Survey of Big Data Archives in Time-Domain Astronomy

et al. 2022

Self Cite

View full text Add to dashboard Cite

show abstract

“…It is a query language interface developed for skilled users. This system supports multi-object search to ease the work of the users belonging to the astronomical domain and also help these users by generating complicated programs [31]. This system uses a workflow method to make the queries understandable to the end user and also make the process of query execution faster.…”

Section: Polystore System-datawnt0 (Existing Work)mentioning

confidence: 99%

Processing Analytical Queries over Polystore System for a Large Astronomy Data Repository

et al. 2022

Self Cite

View full text Add to dashboard Cite

There are extremely large heterogeneous databases in the astronomical data domain, which keep increasing in size. The data types vary from images of astronomical objects to unstructured texts, relations, and key-values. Many astronomical data repositories manage such kinds of data. The Zwicky Transient Facility (ZTF) is one such data repository with a large amount of data with different varieties. Handling different types of data in a single database may have performance and efficiency issues. In this study, we propose a web-based query system built around the Polystore database architecture, and attempt to provide a solution for the growing size of data in the astronomical domain. The proposed system will unify querying over multiple datasets directly, thereby eliminating the effort to translate complex queries and simplify the work for the users in the astronomical domain. In this proposal, we study the models of data integration, analyze them, and incorporate them into a system to manage linked open data provided by astronomical domain. The proposed system is scalable, and its model can be used for various other systems to efficiently manage heterogeneous data.

show abstract

Query Languages for Polystore Databases for Large Scientific Data Archives

Cited by 2 publications

References 8 publications

A Survey of Big Data Archives in Time-Domain Astronomy

A Survey of Big Data Archives in Time-Domain Astronomy

Processing Analytical Queries over Polystore System for a Large Astronomy Data Repository

Contact Info

Product

Resources

About