Recognition of the Teeline shorthand is the interesting research problem. The accurate recognition of the Teeline patterns which helps the journalists to summarize the VIPs talk during the press meets which reduces the writing time. In order to address the above issues, the proposed method addresses the automatic recognition of the Teeline symbols which is used to provide alphabets as output. The framework consists of obtaining the input image, pre-processing it, perform the background subtraction on grayscale image and prepare the dataset for recognition. To prepare the dataset, the letters are written using the digital pen, it generates the pixelsand it is recorded in the Android application. Later these pixels are used to convert them into the image dataset. The prepared database is fed to the manually designed eleven layered Convolutional Neural Network (CNN). CNN is designed in such a way that it accepts the input Teeline alphabet and it able to say the equivalent English alphabet based on the training process. It has been carried out on the MATLAB 2018b and achieved the accuracy of 95%.