There is a wish to be able to enter text into hand-held devices at the speed of speech (around 180 words per minute). Accurate unconstrained speech recognition remains an unresolved research challenge. Commonly used handwriting methods, like block capital letters and cursive script, are relatively slow and can only achieve a fraction of the speed of spoken speech (30 words per minute would be considered fast handwriting). Only handwritten shorthand schemes, which can, with training, be used at speeds in excess of 100 words per minute, can achieve a rate close to the speed of normal speech. This research focuses on techniques of recognizing and translating two shorthand systems-Pitman shorthand and Renqun shorthand, which represent English and Chinese respectively. According to the review of the latest on-line handwriting recognition techniques, most techniques are so sensitive to geometric features of characters that they are not able to achieve a satisfactory recognition accuracy for the recognition of shorthand. Shape recognition techniques recently demonstrated for the recognition of Korean script are applicable for recognizing shorthand handwritings. Based on this, an overall solution to the recognition of both Pitman shorthand and Renqun shorthand is proposed. Recognition approaches of Pitman shorthand components are firstly discussed in detail. A two-stage approach (segmentation & classification) is proposed for the recognition of the consonant outlines, which is the most difficult part in Pitman notation. A template-based matching approach is proposed for the shortform classification. Hausdorff Distance is introduced to measure the similarity between the input outline and the corresponding templates. Compared with Pitman shorthand, both vocalized outlines and shortforms of Renqun shorthand are composed of rhymes and consonants and have similar shape features. Due to the inherited geometric features of Renqun shorthand from Pitman