A genetic programming approach for searching on nearest neighbors graphs

Abstract

Nearest neighbors graphs have gained a lot of attention from the information retrieval community since they were demonstrated to outperform classical approaches in the task of approximate nearest neighbor search. These approaches, firstly, index feature vectors by using a graph-based data structure. Then, for a given query, the search is performed by traversing the graph in a greedy-way, moving in each step towards the neighbor of the current vertex that is closer to the query (based on a distance function). However, local topological properties of vertices could be also considered at the moment of deciding the next vertex to be explored. In this work, we introduce a Genetic Programming framework that combines topological properties along with the distance to the query, aiming to improve the selection of the next vertex in each step of graph traversal and, therefore, reduce the number of vertices explored (scan rate) to find the true nearest neighbors. Experimental results, conducted over three large collections of feature vectors and four different graph-based techniques, show significant gains of the proposed approach over classic graph-based search algorithms.

Vizplan: A Visual Analytics Platform for the Assessment of Multidimensional Indicators Over Time

“…We also plan to investigate the scalability of the tool, when handling large datasets. We plan to integrate indexing schemes to support large-scale similarity-based searches and clustering tasks (Muñoz et al, 2019, Muñoz et al, 2022.…”