Agriculture in India has a vital role in the country's Economy. India's agriculture is composed of many crops and it is the backbone of our country. About 80% of the population in India depending on farming. Hence the modernisation and automation of agriculture with techniques like Internet of Things has a major act in order to make it smart agriculture system. The Aim of project is to employ advance technology i.e. IOT and object detection techniques to come up with smart agriculture system using automation. Monitoring environmental conditions is the main factor to improve the yield of the efficient crops. With today's growing world and raising completion, the farmers are finding difficulty in monitoring the field and maintaining the crops. Hence, this project is developed to help the farmers to monitor the fields and protect and maintain the crops using the approach of Internet of Things (IOT) as well object detection techniques. The DC Pump is automatically switched ON/OFF by the Raspberry Pi and Relay, based on the soil moisture and the temperature level. Intrusion detection mechanism is used to protect the crop from animal or any theft. This is done by object detection technique which detects the type of animal attack and then notifies the farmer by an SMS and an image sent via mail to the farmer, so he can take the necessary steps to prevent higher extent of damage.