Hand gesture detection and recognition is a way to communicate between deaf-mute person and rest of society. In this study, the static sign and the dynamic sign recognition system based on hand gesture is presented. The dynamic sign gesture is more challenging than static sign gesture which contains the movement. The vision based sign language recognition using hand gesture consists of the following main steps: acquisition the sign data, detection the hand region, extraction the features and recognition. The data acquisition stage, the data acquired by using web camera without using any data gloves and special markers. In hand region detection process, this study proposed hybrid hand region detection process by combining CbCr channel from YCbCr colour space and motion detection by using mean filter background subtraction to definitely segment the hand region from the background. In hand feature extraction, the scale, shape, texture and orientation features extracted by using GIST (Generalized Search Tree), HOG (histogram of gradient) and HOG-LBP (Local Binary Pattern) methods. Finally, Quadratic Support Vector Machine (QSVM), Cubic Support Vector Machine (CSVM) and Linear Discriminant recognized the static and dynamic hand gesture. The recognition accuracy achieved 86.7% and 99.22 % acceptable accuracy on self-construct dynamic Myanmar sign word dataset and MUDB dataset.