Sarve: synthetic data and local differential privacy for private frequency estimation

Abstract

The collection of user attributes by service providers is a double-edged sword. They are instrumental in driving statistical analysis to train more accurate predictive models like recommenders. The analysis of the collected user data includes frequency estimation for categorical attributes. Nonetheless, the users deserve privacy guarantees against inadvertent identity disclosures. Therefore algorithms called frequency oracles were developed to randomize or perturb user attributes and estimate the frequencies of their values. We propose Sarve, a frequency oracle that used Randomized Aggregatable Privacy-Preserving Ordinal Response (RAPPOR) and Hadamard Response (HR) for randomization in combination with fake data. The design of a service-oriented architecture must consider two types of complexities, namely computational and communication. The functions of such systems aim to minimize the two complexities and therefore, the choice of privacy-enhancing methods must be a calculated decision. The variant of RAPPOR we had used was realized through bloom filters. A bloom filter is a memory-efficient data structure that offers time complexity of O(1). On the other hand, HR has been proven to give the best communication costs of the order of log(b) for b-bits communication. Therefore, Sarve is a step towards frequency oracles that exhibit how privacy provisions of existing methods can be combined with those of fake data to achieve statistical results comparable to the original data. Sarve also implemented an adaptive solution enhanced from the work of Arcolezi et al. The use of RAPPOR was found to provide better privacy-utility tradeoffs for specific privacy budgets in both high and general privacy regimes.

Privacy-Preserving Data Collection and Analysis for Smart Cities

“…, + (n − 1) log γ (∈ , , n) = ∈. (71) It is difficult to solve (71) algebraically, but it can easily be solved numerically.…”

“…Many methods have been proposed for estimating a histogram distribution of users' values under.∈-LDP, such as the Randomized Aggregatable Privacy-Preserving Ordinal Response, Sarve, and so on [ 13,71]. Although such methods achieve high accuracy, their techniques cannot be applied to a person-to-person interaction scenario.…”

A Survey on the Use of Synthetic Data for Enhancing Key Aspects of Trustworthy AI in the Energy Domain: Challenges and Opportunities

“…The concept of DP has been well-established and applied to the concept of FL [218][219][220]. DP has also been utilized for various use cases involving synthetic data [221][222][223][224].…”

Harnessing the power of synthetic data in healthcare: innovation, application, and privacy

“…Brauneck et al 63 recently reviewed privacy-enhancing technologies (PETs) from a legal standpoint to engage in a thoughtful discussion of how GDPR legislation in the European Union (EU) relates to commonly used PETs including federated learning (FL), secure multiparty computation (SMPC), and differential privacy (DP). DP a concept first proposed in 2006 by Dwork et al 64 , is gaining broad acceptance as a solid, practical, and trustworthy privacy framework and its application has been also explored with synthetic data [65][66][67] . DP is a precise mathematical constraint that ensures the privacy of individual pieces of information in a database while answering queries about the aggregate.…”