Recent studies provide mixed results regarding whether the perception of facial attractiveness is increased or decreased by partial occlusion with a sanitary mask. One set of studies demonstrated that occluding the bottom half of a face increased facial attractiveness. This effect is thought to occur because the occluded area is interpolated by an average facial representation that is perceived as attractive. However, several groups of studies showed that partial occlusion can increase or decrease perceived attractiveness depending on the attractiveness of the original (unoccluded) face, due to regression to the mean. To reconcile this inconsistency, we propose that the occluded area is interpolated not by an average facial representation, but by a template of moderate attractiveness, shaped by the distribution of each viewer’s experience. This hypothesis predicts an interaction between occlusion and the attractiveness of the original face so that occluded attractive faces are rated as less attractive, while occluded unattractive faces are rated as more attractive. To examine this hypothesis, the present study used attractiveness-rating tasks with mask-free versus masked faces in own-race and other-races categories. Viewers were familiar with own-race faces and unfamiliar with other-races faces. If moderate-attractiveness interpolation were the explanatory factor, the interaction between the occlusion and the attractiveness of the original face should be found only in the rating of own-race faces. Consistent with this hypothesis, the interaction between the occlusion and the attractiveness of the original faces was significant only for the own-race faces. Specifically, wearing a sanitary mask decreased the facial attractiveness of attractive faces in the own-race, while it increased the attractiveness regardless of the level of facial attractiveness in other-races. These findings suggest that the occluded area of own-race faces is interpolated by a facial template of moderate attractiveness. The other-races template could be developed using familiar exemplars such as celebrities. Thus, interpolation by such a template should result in elevated attractiveness relative to that by an own-race template. Accordingly, the apparent inconsistency in the literature regarding the effect of partial occlusion on physical attractiveness can be explained in terms of differences in the template involving interpolation of the occluded area.