Animal conservation is imperative, and a lot of technology has been used in different ways. The endangered species like tiger and elephant has raised the need for such efforts. Human-Elephant Collision (HEC) has been an active area of research but still, the optimum solution is not found. As trains are widely used transportation medium in Asian countries, the rail track is even laid down through forest areas and hence intervene the wildlife. Elephants due to their bulky size often become victims of trains. Such tragedy is common especially in green belts in southern zones of India. To rectify the problem, we have proposed a deep vision-based model to identify the elephant near-site using implanted video cameras. Four different models are proposed for the identification of elephants in image/video. One novel lightweight CNN based model is proposed. Three Transfer Learning (TL) models, i.e., ResNet50, MobileNet, Inception V3 have been experimented and tuned for elephant detection. These highly accurate and precise models can alarm the trains hence it can save a precious life.