Agriculture in India is a vital sector that contains a major portion of the population and impacts substantially the country’s economy. Cocoa is a crop that has commercial importance and is used for the production of chocolates. It is one of the main crops cultivated in south India due to the humid tropical climate. However, the cocoa plant is susceptible to various diseases caused by bacteria, viruses, and pests resulting in yield losses. Visual analysis is a subjective and time-consuming process. Further, farmers use improper pesticides to prevent diseases, and this will degrade the plant and soil quality. To overcome these problems, this paper proposes an automatic cocoa plant disease detection and pesticide recommendation system using computer vision and deep learning techniques. The proposed system was evaluated on several cocoa plant images, and an accuracy of 97.36% was obtained in disease classification. The proposed system can help cocoa farmers in the detection of cocoa plant diseases in the early stage and reduce the use of excessive pesticides, thus promoting sustainable agriculture practices.