Background Minority-serving hospitals have greater readmission rates after operative procedures including colectomy; however, little is known about the contribution of hospital factors to readmission risk and mortality in this setting. This study evaluated the impact of hospital factors on readmissions and inpatient mortality after colorectal resections at minority-serving hospitals in the context of patient and procedure-related factors. Methods More than 168,000 patients who underwent colorectal resections in 374 California hospitals (2004–2011) were analyzed using the State Inpatient Database and American Hospital Association Hospital Survey data. Sequential logistic regression analyses were performed to determine the associations between minority-serving hospital status and 30-day, 90-day, and repeated readmissions. Results Thirty-day, 90-day, and repeated readmission rates were 11.2%, 16.9%, and 2.9%, respectively. Odds for 30-day, 90-day, and repeated readmissions after colorectal resections were 19%, 20%, and 38% more likely at minority-serving hospitals versus non-minority-serving hospitals, respectively (P < .01), after controlling for age, sex, comorbidities, year, and procedure type. Patient factors accounted for up to 65% of the observed increase in odds for readmission at minority-serving hospitals while hospital-level factors contributed roughly 40%. Inpatient mortality was significantly greater at minority-serving hospitals versus non-minority-serving hospitals (4.9% vs 3.8%; P <.001). Risk factors significantly associated with readmissions and inpatient mortality included Medicaid/Medicare primary insurance, emergent operation, and ostomy creation. Low procedure volume was significantly associated with increased odds for inpatient mortality. Conclusion Patient-level factors seemed to dominate the increased readmission risk after colorectal resections at minority-serving hospitals while hospital factors were less contributory. These findings need to be further validated to shape quality improvement interventions to decrease readmissions.