Although visual attention models have shown good performance in general environments, applying it for filtering objectionable image needs consideration for skin information. Therefore, in this paper, we proposed the saliency detection method specialized in adult image classification using the skin color and the contrast information. Skin information combined saliency map is generated by merging the saliency map of visual attention model and the skin probability map. In order to prove the effectiveness of the proposed method, we consider the use of a saliency map in objectionable image classification.