Efficient top/bottom-k fraction estimation in spatial databases using bounded main memory

Abstract

Spatial databases store objects with their locations and certain types of attached items. A variety of modern applications have been developed by leveraging the utilization of locations and items in spatial objects, such as searching points of interest, hot topics, or users' attitude in specified spatial regions. In many scenarios, the high and low-frequency items in a spatial region are worth noticing, considering they represent the majority's interest or eccentric users' opinion. However, existing works have yet to identify such items in an interactive manner, despite the significance of the endeavor in decision-making systems. This study recognizes a novel type of analytical query, called top/bottom-k fraction query, to discover such items in spatial databases. To achieve fast query response, we propose a multilayered data summary that is spread out across the main memory and external memory. A memory-based estimation method for top/bottom-k fraction queries is proposed. To maximize the use of the main memory space, we design a data summary tuning method to dynamically allocate memory space among different spatial partitions. The proposed approach is evaluated with real-life datasets and synthetic datasets in terms of estimation accuracy. Evaluation results demonstrate the effectiveness of the proposed data summary and corresponding estimation and tuning algorithms.

Research on technical system of environmental comprehensive perception

“…From the perspective of data model, it is necessary to break through the data organization mode of single environmental factor and loosely coupled data integration mode, directly face the comprehensive application goal, and solve the problem of multi-source, multimodal and multi-factor data integration management; From the perspective of database technology, the key point is to strengthen the security of the database, so that the unique information can be properly guaranteed. At the same time, make full use of existing distributed networking, big data and other technologies to improve the data and database security while improving the data experience; additionally, leveraging existing technologies such as distributed networking and big data can improve both data and database security while enhancing the overall user experience [8][9][10] . Furthermore, from a data service perspective, providing fast, flexible, and professional data services to data users is also a crucial aspect to consider in data management.…”

The Complexity of the Data Retrieval Process Using the Proposed Index Extension

“…Using the parallel option, the table block set is divided into several sub-parts, each assigned to one process run in a parallel mode. Therefore, an index can be created rapidly sooner, depending on the number of CPUs, physical data definition, disc storage allocation, configuration, distribution, and partitioning [26,46,47]. The following code highlights the description of parallelism.…”