Background: The relationship between the size of the primary tumor and the prognosis of patients with metastatic renal cell carcinoma (mRCC) is unclear. In this study, we aimed to investigate the significance of the size of the primary tumor in mRCC. Methods: We retrospectively reviewed the data of patients with mRCC who underwent cytoreductive nephrectomy (CN) from 2006 to 2013 in a Chinese center (n = 96) and those in the Surveillance, Epidemiology, and End Results (SEER) database (from 2004 to 2015, n = 4403). Tumors less than 4 cm in size were defined as small. Prognostic factors were analyzed using univariate and multivariate Cox proportional hazards regression analyses. Results: Patients with small tumors had a longer overall survival than other patients, both in the Chinese cohort (median, 30.0 vs 24.0 months, P = 0.026) and the SEER cohort (median, 43.0 vs 23.0 months, P < 0.001). After adjusting for other significant prognostic factors, small tumor size was still an independent protective factor in the Chinese cohort (adjusted hazard ratio [HR], 0.793; 95% confidence interval [CI]: 0.587–0.998, P = 0.043). In the SEER cohort, multivariate analysis showed that small tumor size was also an independent protective factor (HR, 0.880; 95% CI: 0.654–0.987, P = 0.008). In addition, as a continuous variable, a 1 cm elevation in tumor size translated into a 3.8% higher risk of death (HR, 1.038; 95% CI, 1.029–1.046; P < 0.001). Conclusion: Patients with small tumors may have a favorable prognosis after CN for mRCC. Although CN is not a standard protocol in mRCC, small tumor size may be a candidate when we are deciding to perform CN because of the potential benefit for OS.