Transform-based compression for quadratic similarity queries

Wu, Hanwei; Flierl, Markus

doi:10.1109/acssc.2017.8335363

Cited by 3 publications

(1 citation statement)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[8] proposes tree-structured vector quantizers that hierarchically cluster the data using k-center clustering. In [9], the authors compare two transform-based similarity identification schemes to cope with exponentially growing codebooks for highdimensional data. One of the proposed schemes, that is, the component-based approach, exhibits both good performance and low search complexity.…”

Section: Introductionmentioning

confidence: 99%

Computing Similarity Queries for Correlated Gaussian Sources

Wu¹,

Wang²,

Flierl

2020

Preprint

Self Cite

View full text Add to dashboard Cite

Among many current data processing systems, the objectives are often not the reproduction of data, but to compute some answers based on the data resulting from queries. The similarity identification task is to identify the items in a database that are similar to a given query item for a given metric. The problem of compression for similarity identification has been studied in [1]. Unlike classical compression problems, the focus is not on reconstructing the original data. Instead, the compression rate is determined by the desired reliability of the answers. Specifically, the information measure identification rate characterizes the minimum rate that can be achieved among all schemes which guarantee reliable answers with respect to a given similarity threshold. In this paper, we propose a componentbased model for computing correlated similarity queries. The correlated signals are first decorrelated by the Karhunen-Loève transform (KLT). Then, the decorrelated signal is processed by a distinct D-admissible system for each component. We show that the component-based model equipped with KLT can perfectly represent the multivariate Gaussian similarity queries when optimal rate-similarity allocation applies. Hence, we can derive the identification rate of the multivariate Gaussian signals based on the component-based model. We then extend the result to general Gaussian sources with memory. We also study the models equipped with practical component systems. We use TC-schemes that use type covering signatures and triangleinequality decision rules [1] as our component systems. We propose an iterative method to numerically approximate the minimum achievable rate of the TC-scheme. We show that our component-based model equipped with TC-schemes can achieve better performance than the TC-scheme unaided on handling the multivariate Gaussian sources.

show abstract

Section: Introductionmentioning

confidence: 99%