Abstract. In machine learning, the accuracy of the system depends upon classification result. Classification accuracy plays an imperative role in various domains. Non-parametric classifier like K-Nearest Neighbor (KNN) is the most widely used classifier for pattern analysis. Besides its easiness, simplicity and effectiveness characteristics, the main problem associated with KNN classifier is the selection of number of nearest neighbors i.e. 'k' for computation. At present it is hard to find the optimal value of 'k' using any statistical algorithm, which gives perfect accuracy in terms of low misclassification error rate.Motivated by prescribed problem, a new sample space reduction weighted voting mathematical rule (AVNM) is proposed for classification in machine learning. Proposed AVNM rule is also non-parametric in nature like KNN. AVNM uses the weighted voting mechanism with sample space reduction to learn and examine the predicted class label for unidentified sample. AVNM is free from any initial selection of predefined variable and neighbor selection as found in KNN algorithm. Proposed classifier also reduces the effect of outliers.To verify the performance of the proposed AVNM classifier, experiments are made on 10 standard dataset taken from UCI database and one manually created dataset. Experimental result shows that the proposed AVNM rule outperforms KNN classifier and its variants. Experimentation results based on confusion matrix accuracy parameter proves higher accuracy value with AVNM rule.Proposed AVNM rule is based on sample space reduction mechanism for identification of optimal number of nearest neighbor selections. AVNM results in better classification accuracy and minimum error rate as compared with state-of-art algorithm, KNN and its variants. Proposed rule automates the selection of nearest neighbor selection and improves classification rate for UCI dataset and manual created dataset.