An efficient driver assistance system is essential to avoid mishaps. The collision between the vehicles and objects before vehicle is the one of the principle reason of mishaps that outcomes in terms of diminished safety and higher monetary loss. Researchers are interminably attempting to upgrade the safety means for diminishing the mishap rates. This paper proposes an accurate and proficient technique for identifying objects in front of vehicles utilizing thermal imaging framework. For this purpose, image dataset is obtained with the help of a night vision IR camera. This strategy presents deep network based procedure for recognition of objects in thermal images. The deep network gives the model understanding of real world objects and empowers the object recognition. The real time thermal image database is utilized for the training and validation of deep network. In this work, Faster R-CNN is used to adequately identify objects in real time thermal images. This work can be an incredible help for driver assistance framework. The outcomes exhibits that the proposed work assists to boost public safety with good accuracy.