Differential privacy for learning vector quantization

Abstract

Prototype-based machine learning methods such as learning vector quantization (LVQ) offer flexible classification tools, which represent a classification in terms of typical prototypes. This representation leads to a particularly intuitive classification scheme, since prototypes can be inspected by a human partner in the same way as data points. Yet, it bears the risk of revealing private information included in the training data, since individual information of a single training data point can significantly influence the location of a prototype. In this contribution, we investigate the question how to algorithmically extend LVQ such that it provably obeys privacy constraints as offered by the notion of so-called differential privacy. More precisely, we demonstrate the sensitivity of LVQ to single data points and hence the need of its extension to private variants in case of possibly sensitive training data. We investigate three technologies which have been proposed in the context of differential privacy, and we extend these technologies to LVQ schemes. We investigate the effectiveness and efficiency of these schemes for various data sets, and we evaluate their scalability and robustness as regards the choice of meta-parameters and characteristics of training sets. Interestingly, one algorithm, which has been proposed in the literature due to its beneficial mathematical properties, does not scale well with data dimensionality, while two alternative techniques, which are based on simpler principles, display good results in practical settings. * Funding by the CITEC center of excellence (EXC 277) is gratefully acknowledged.

[Retracted] Using an Optimized Learning Vector Quantization‐ (LVQ‐) Based Neural Network in Accounting Fraud Recognition

“…A sound internal mechanism will greatly reduce the probability of accounting fraud, and there are loopholes where defective internal mechanism will increase the possibility of accounting fraud. In the research of Brinkrolf et al [ 7 ], it contains two internal environmental characteristics of accounting fraud, the company's internal governance structure and the company's operating performance. The internal environmental characteristics of accounting fraud studied in this article include board structure, director encouragement, leadership structure, ownership structure, and executive incentives.…”

Neural Classification of Compost Maturity by Means of the Self-Organising Feature Map Artificial Neural Network and Learning Vector Quantization Algorithm

“…In fact, it is this algorithm that tries to transfer pattern vectors to the positions, which correspond to the centres of concentration occurring in data. In order to achieve the quality of classification, it was desirable for pattern vectors to be arranged within the range of classes so that they could represent natural concentrations inside each of the classes [17,18].…”

Differential Privacy for Industrial Internet of Things: Opportunities, Applications and Challenges

“…In [70], Zhang et al proposed the correlated differential privacy and it is helpful for feature selection in machine learning. In [71], Brinkrolf et al put forward the differential privacy method for learning vector quantization. In addition, Gong et al made use of differential privacy for regression analysis based on relevance in [72], and Ke et al proposed the AQ-DP in [73], which can be used as new differential privacy scheme designed for big data quasi-identifier classifying.…”