Image naturalness is a potent attribute to enhance image quality, and it is related to people's perception of memory colors. Many previous experiments aimed to locate the memory colors on different media. Their findings indicate that the memory colors obtained vary between color patches and images and between experimental techniques. However, there were no satisfying models with appropriate memory color centers to scale the image naturalness. This study generated an image database including three prototypical memory colors images (sky, grass, and skin) and their local processed images. First, visual naturalness and preference data were collected from a psychophysical experiment. Then, the distribution of naturalness followed by memory color positions was analyzed. Based on the distribution pattern, the ellipsoid models for each prototypical memory color were established. The results from the present memory color centers were compared with those from the other studies. Results show that the present color centers always give better prediction accuracy in image naturalness models. Finally, an image preference model was developed based on the image naturalness and colorfulness.