Rice is the staple diet for most of the world’s population and is considered a major staple crop in China. Anhui province of China is among the leading provinces for rice production, consumption, and commodities; it is well-known as the “land of fish and rice”. Japonica rice cultivation in Anhui Province is mainly categorized into late-maturing medium, early-maturing medium, and early-maturing late japonica. This review explores the suitable ecological zone distribution and corresponding climate characteristics of the three types of japonica rice in Anhui Province. Data on japonica rice varieties approved in the province over the past twenty years were collected, illustrating the development process of japonica rice varieties in the province and their quality and resistance to rice blast disease. The review shows that the yield is positively and significantly correlated with agronomic traits, such as the number of effective panicles and the total number of grains per panicle, plant height, etc. In addition, it elucidates the major problems faced by Anhui’s japonica rice breeding and cultivation, such as frequent events of high temperatures, rice blast disease, and medium to low soil fertility levels. Considering the existing issues in breeding japonica rice varieties in Anhui Province, this review proposes a strategy for breeding high-yield and disease-resistant japonica rice varieties, particularly varieties adaptable to medium and low fertility soil conditions. In brief, this article provides a theoretical basis and practical recommendations for the sustainable development of japonica rice in the Anhui Province of China.