Rice is a staple food source for most countries in the world, including Indonesia. The problem of rice disease is a problem that is quite crucial and is experienced by many farmers. Approximately 200,000 - 300,000 tons per year the amount of rice attacked by pests in Indonesia. Considerable losses are caused by late-diagnosed rice plant diseases that reach a severe stage and cause crop failure. The limited number of Agricultural Extension Officers (PPL) and the Lack of information about disease and proper treatment are some of the causes of delays in handling rice diseases. Therefore, with the development of information technology and computers, it is possible to identify diseases by utilizing Artificial Intelligence, one of which is by using recognition methods based on image processing and pattern recognition technology. The purpose of this research is to create a Machine Learning model by applying the model architecture from Resnet101 combined with the model architecture from the author. The model proposed in this study produces an accuracy of 98.68%.