In this work, an attempt is made to build a dataset for handwritten Kannada characters and also to recognize the isolated Kannada vowels, consonants, modifiers, and ottaksharas. The dataset is collected from 500 writers of varying ages, gender, qualification, and profession. This dataset will be used to recognize the handwritten kagunita's, ottaksharas, and other base characters, where the existing works have addressed very less on the recognition of kagunita's and ottaksharas. There are no datasets for the same. Hence, a dataset for handwritten 85 characters is built using an unsupervised machine learning technique i.e K-means hierarchical clustering with Run Length Code (RLC) features. An accuracy of 80% was achieved with the unsupervised method. The dataset consists of 130,981 samples for 85 classes, these classes are further divided into upper, lower, and middle zones based on the position of the character in the dialect. After the dataset was built SVM model with HOG features was used for recognition and an accuracy of 99.0%, 88.6%, and 92.2% was obtained for the Upper, Middle, and Lower zones respectively to increase the recognition rate, the CNN model is fine-tuned with raw input, and an accuracy of 100%, 96.15%, and 95.38% was obtained for the Upper, Middle, and Lower zones respectively. With the ResNet18 model, an accuracy of 99.88%, 98.92, and 97.55% was obtained for each of the zones respectively. The dataset will be made available online for the researchers to carry out their research on handwritten characters, kagunitas, and word recognition with segmentation.