Reaching high accuracy in handwritten character recognition is an essential challenge since it is widely used in many fields such as signature analysis and forgery detection. Recently, deep learning has demonstrated efficiency in this field. The problem with deep learning is that it uses a vast number of parameters that require a large dataset for training. To overcome this problem, an intelligent network is proposed in this study, based on the computational function of the dentate gyrus of the brain's hippocampus. The ability to separate patterns with high overlapping is a task that is referred to as the dentate gyrus. Handwritten character images have high overlapping due to various writers' styles, or even one writer's style under different conditions. Therefore, proposing a network based on the dentate gyrus' functional computation can be useful in this field. One of the prominent features of the proposed network is employing two excitation steps and two inhibition steps, augmenting the accuracy of recognizing handwritten characters. The proposed network was evaluated with six datasets of digits and characters from five languages. Experiments on all of the used datasets showed promising results. Moreover, a comparative and detailed analysis of the proposed network with other SOM-based and deep learning methods is provided. Experimental results show a significant boost in accuracy. While the character error rate (CER) was smaller than 1.85% for all the experiments, the smallest CER of 0.6% was achieved by the MNIST dataset. Moreover, in recognizing patterns with high noise, the proposed network showed satisfactory results.