Accurate retrieval of ice surface temperature (IST) over the Arctic ice-water mixture zone (IWMZ) is significantly essential for monitoring the change of the polar sea ice environment. Previous researchers have focused on evaluating the accuracy of IST retrieval in pack ice regions, possibly on account of the availability of in situ measurement data. Few of them have assessed the accuracy of IST retrieval on IWMZ. This study utilized Landsat 8/TIRS and Operation IceBridge observations (OIB) to evaluate the accuracy of the current IST retrieval method in IWMZ and proposed an adjustment method for improving the overall accuracy. An initial comparison shows that Landsat 8 IST and OIB IST have minor differences in the pack ice region with RMSE of 0.475 K, MAE of 0.370 K and cold bias of −0.256 K. In the thin ice region, however, the differences are more significant, with RMSE of 0.952 K, MAE of 0.776 K and warm bias of 0.703 K. We suggest that this phenomenon is because the current ice-water classification method misclassified thin ice as water. To address this issue, an adjusted method is proposed to refine the classification of features within the IWMZ and thus improve the accuracy of IST retrieval using Landsat 8 imagery. The results demonstrate that the accuracy of the retrieved IST in the two cases was improved in the thin ice region, with RMSE decreasing by about 0.146 K, Bias decreasing by about 0.311 K, and MAE decreasing by about 0.129 K. After the adjustment, high accuracy was achieved for both pack ice and thin ice in IWMZ.