Language has a prime role in communication between persons, in learning, in distribution of concepts and in preserving public contacts. The hearing-impaired have to challenge communication obstacles in a mostly hearing-capable culture. There are hundreds Sign Languages that are used all around the world today .The Sign Languages are established depending on the country and area of the deaf public. The aim of sign language recognition is to offer an effectual and correct tool to transcribe hand gesture into text. It can play a vital role in the communiqué between deaf and hearing society. Sign language recognition (SLR), as one of the significant research fields of human–computer interaction (HCI), has produced more and more interest in HCI society. Since, artificial neural networks are best suited for automated pattern recognition problems; they are used as a classification tool for this research. Back propagation is the most important algorithm for training neural networks. But, it easily gets trapped in local minima leading to inaccurate solutions. Therefore, some global search and optimization techniques were required to hybridize with artificial neural networks. One such technique is Genetic algorithms that imitate the principle of natural evolution. So, in this article, a hybrid intelligent system is proposed for sign language recognition in which artificial neural networks are merged with genetic algorithms. Results show that proposed hybrid model outperformed the existing back propagation based system.