The widespread impacts of projected global and regional climate change on rice yield have been investigated by different indirect approaches utilizing various simulation models. However, direct approaches to assess the impacts of climatic variabilities on rice growth and development may provide more reliable evidence to evaluate the effects of climate change on rice productivity. Climate change has substantially impacted rice production in the mid-high latitudes of China, especially in Northeast China (NEC). Climatic variabilities occurring in NEC since the 1970s have resulted in an obvious warming trend, which made this region one of the three major rice-growing regions in China. However, the projections of future climate change have indicated the likelihood of more abrupt and irregular climatic changes, posing threats to rice sustainability in this region. Hence, understanding the self-adaptability and identifying adjustive measures to climate variability in high latitudes has practical significance for establishing a sustainable rice system to sustain future food security in China. A well-managed field study under randomized complete block design (RCBD) was conducted in 2017 and 2018 at two study sites in Harbin and Qiqihar, located in Heilongjiang province in NEC. Four different cultivars were evaluated: Longdao-18, Longdao-21 (longer growth duration), Longjing-21, and Suijing-18 (shorter growth duration) to assess the inter-relationships among grain-filling parameters, grain yield and yield components, and grain quality attributes. To better compare the adaptability mechanisms between grain-filling and yield components, the filling phase was divided into three sub-phases (start, middle, and late). The current study evaluated the formation and accumulation of the assimilates in superior and inferior grains during grain-filling, mainly in the middle sub-phase, which accounted for 59.60% of the yield. The grain yields for Suijing-18, Longjing-21, Longdao-21, and Longdao-18 were 8.02%, 12.78%, 17.19%, and 20.53% higher in Harbin than those in Qiqihar, respectively in 2017, with a similar trend observed in 2018. At Harbin, a higher number of productive tillers was noticed in Suijing-18, with averages of 17 and 15 in 2017 and 2018, respectively. The grain-filling parameters of yield analysis showed that the filling duration in Harbin was conducive to increased yield but the low dry weight of inferior grains was a main factor limiting the yield in Qiqihar. The average protein content values in Harbin were significantly higher (8.54% and 9.13%) than those in Qiqihar (8.34% and 9.14%) in 2017 and 2018, respectively. The amylose content was significantly higher in Harbin (20.03% and 22.27%) than those in Qiqihar (14.44% and 14.67%) in 2017 and 2018, respectively. The chalkiness percentage was higher in Qiqihar, indicating that Harbin produced good quality rice. This study provides more direct evidence of the relative changes in rice grain yield due to changes in grain-filling associated with relative changes in environmental components. These self-adaptability mechanisms to climatic variability and the inter-relationships between grain-filling and grain yield underscore the urgent to investigate and explore measures to improve Japonica rice sustainability, with better adaptation to increasing climatic variabilities. These findings may also be a reference for other global rice regions at high latitudes in addressing the impacts of climate change on future rice sustainability.