Recognition of age and gender has become a significant part of the biometric system, protection, and treatment. It is widely used for people to access age-related content. It is used by social media in the distribution of layered advertising and promotions to expand its scope. Application of face detection has grown to a great extent that we should upgrade it using various methods to achieve more accurate results. In this paper, we have developed a lightweight deep Convolution neural network model for real-time age and gender prediction. For making the training dataset more diverse, Wiki, UTKFace, and Adience datasets have been merged into one containing 18728 images. Using this vast mixed dataset, we have achieved accuracy of 48.59% and 80.76% for age and gender respectively. Further, the model is tested in real-time. Different experimental investigations on the prepared dataset show that with most recent approaches, our model provides competitive prediction accuracy.