Inexisting interfaces such as Digital pen which capture only one kind of gesture and in proposed system interfaces it brings a new interaction process. It can recognize both small scale and large scale gestures. An algorithmic framework is for information about Acceleration and Surface Electromyographical (SEMG) signals for gesture identification. In addition, the system consist of a wearable gesture sensing device and an application program along with the algorithmic framework for a mobile phone, will be designed to realize gesture-based real-time interaction. The device which is worn on the forearm, using that device user will be able to manipulate a mobile phone using predefined gestures or even personalized ones. In this system Accelerometer Sensor measure large scale gesture and SEMG sensors measure the small scale gesture. Both this sensors are used for the gesture recognition.