The purpose of this study was to investigate the effects of the undersurface roughness of total knee prosthesis on clinical outcomes. We compared the clinical and radiological outcomes and prosthesis survivals in patients who underwent total knee arthroplasty using prosthesis with identical designs but different surface roughness (average surface roughnesses (Ra), 5.0 μm vs. 11.6 μm). The results showed that the knee prostheses with a more roughened undersurface (Ra = 11.6 μm) produced significantly better functional results and enhanced prosthesis survival. The difference in surface roughness was associated with incidence of osteolysis and loosening at the tibial baseplate, but not at the femoral component. Overall, our results provided significant evidence that the use of roughened undersurface of tibial baseplate would be a way to prevent aseptic loosening.