Background: Climate change, particularly rising temperatures, negatively affects rice grain quality, increasing chalky grain percentage (CG) and hampering rice grade and price. Heat-tolerant cultivars have been bred and released since the 2000s, but the effectiveness of heat tolerance in reducing the occurrence of CG has yet to be quantified. Objectives: This study aimed to measure the effectiveness of breeding for better heat tolerance in reducing the negative impact of high temperatures on rice quality. Methods: Through a systematic literature search, we developed a dataset including 1297 field observations covering 48 cultivars from five different heat-tolerant ranks (HTRs) at 44 sites across Japan. A linear mixed-effect model (LME) and a random forest model (RF) were fitted to the data to analyze the effect of HTR and climatic factors such as the cumulative mean air temperature above 26°C (TaHD), mean solar radiation and mean relative humidity for 20 days after heading on CG. Results: The LME model explained 63 % of the variation with a 14% RMSE. The RF partial dependence plot revealed that the logit-transformed CG response to climate factors was linear, supporting the assumption of LME. The statistical analysis showed that CG increased as a function of TaHD (P < 0.001), with significant differences among HTRs (P < 0.001). The strongest effect of TaHD was obtained for the lowest HTR and was found to decrease with increasing HTR. CG also increased with higher relative humidity (P < 0.001) and solar radiation (P < 0.01). Based on our modeling, we estimated that as TaHD increased from 20 to 80 degrees Cd (equivalent to a mean temperature increase from 27 degrees C to 30 degrees C), CG increased by 66 points for cultivars with the lowest HTR, 45 points for cultivars with an intermediate HTR, and 19 points for cultivars with the highest HTR. Raising HTR by just one step (from intermediate to moderately tolerant) is projected to increase the proportion of first-grade rice at a grain-filling temperature of 27 degrees C, but tolerance levels need to be improved further in case of stronger warming. Conclusions: The effect of high temperatures on CG was highly dependent on the cultivar's HTR. Improvements in HTR effectively reduce the negative impacts of high temperatures on rice grain quality. Significance: Heat-tolerant cultivars are projected to suppress the prevalence of CG more than threefold compared with heat-sensitive cultivars when grain-filling temperature increases from 27 to 30 degrees C.