Normal human Beings can communicate with each other with the help of various different languages, however, the people who can't speak have different sign languages to communicate with others. But a major setback of sign language is that only people those who know sign language can communicate with them. Individuals habitually use gestures to interconnect. Gestures are used for directing to an individual, to get his devotion and convey statistics about temporal and spatial physiognomies. Gesticulating does not only elaborate verbal language, but it is part of the language production practice. In our paper we recommend a scheme which will be able to convert the sign language into words or sentences. The system takes inputs several hand gestures then processes its meaning and verifies it with the stored gestures in database and results the corresponding output on the screen.