2016 International Conference on Computational Science and Computational Intelligence (CSCI) 2016
DOI: 10.1109/csci.2016.0225
|View full text |Cite
|
Sign up to set email alerts
|

CIFAR-10: KNN-Based Ensemble of Classifiers

Abstract: Abstract-In this paper, we study the performance of different classififers on the CIFAR-10 dataset, and build an ensemble of classifiers to reach a better performance. We show that, on CIFAR-10, K-Nearest Neighbors (KNN) and Convolutional Neural Network (CNN), on some classes, are mutually exclusive, thus yield in higher accuracy when combined. We reduce KNN overfitting using Principal Component Analysis (PCA), and ensemble it with a CNN to increase its accuracy. Our approach improves our best CNN model from 9… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
3
1
1

Citation Types

0
23
0

Year Published

2018
2018
2024
2024

Publication Types

Select...
6
3

Relationship

0
9

Authors

Journals

citations
Cited by 54 publications
(23 citation statements)
references
References 21 publications
0
23
0
Order By: Relevance
“…But according to the best-known results, K-Nearest neighbor can reach 35% accuracy if it's used with the right distance function and right value of K. and there are also other ways such as principal component analysis which could improve its performance furthermore. Moreover, KNN nearest neighbor could be used in combination with convolutional neural networks to increase its accuracy [2].…”
Section: B Experiments and Resultsmentioning
confidence: 99%
See 1 more Smart Citation
“…But according to the best-known results, K-Nearest neighbor can reach 35% accuracy if it's used with the right distance function and right value of K. and there are also other ways such as principal component analysis which could improve its performance furthermore. Moreover, KNN nearest neighbor could be used in combination with convolutional neural networks to increase its accuracy [2].…”
Section: B Experiments and Resultsmentioning
confidence: 99%
“…In this area, Y. Abouelnaga and al tried on their work to work on an assembled model that use several CNN models and combine it with a KNN approach optimized by PCA (principal component analysis), and they have achieved good results on classifying the CIFAR-10 ( Fig. 1) dataset [2]. In the same area, L. H. Thai et al have used SVM together with artificial Neural networks to construct their model.…”
Section: Introductionmentioning
confidence: 99%
“…The prototype obtained 78.90% accuracy in classification of a said dataset on a GPU unit. Abouelnaga et al [33] constructed a collaborative classifier on K-nearest neighbor. They used a combination of KNN and CNN to reduce the overfitting by Principal Component Analysis (PCA).…”
Section: Related Workmentioning
confidence: 99%
“…It provides a good insight on how some networks can even exceed the human accuracy of 93.91%. [2] presents the accuracy achieved by various conventional machine learning algorithms such as Logistic Regression, K-Nearest Neighbors (KNN), Support Vector Machine (SVM), and a combination of these algorithms with Principal Component Analysis (PCA). It also aims to study CNNs and has achieved an accuracy of 94.03% using an ensemble ABSTRACT of four CNN classifiers and one KNN classifier along with data augmentation.…”
Section: Related Workmentioning
confidence: 99%