Comparison of kNN Classifier and Simple Neural Network in Handwritten Digit Recognition Using MNIST Database

The choice of the appropriate method in the classification task is most often a problem related to the adaptation of the input data to the classifier. However, adaptation alone does not result in high classification scores. In this paper, we present a comparison of two artificial intelligence methods for recognizing and classifying the handwriting of digits. The study was based on the popular MNIST database, and we dug up algorithms such as K-nearest neighbors and also neural networks to conduct the study. The paper presents mathematical models of selected tools and selected network architecture. Then, the results of the research carried out in order to choose a more accurate character classification technique are presented. For the purpose of verification, the accuracy metric and the analysis using the error matrix were used. Article also includes analysis of different variables to used methods, like metrics (Euclidean, Manhattan and Chebyshev) or hyperparameter k.