Color is a main channel to express emotions of an image. Selecting a good color scheme with color harmony and proper emotional expression is very important in many fields, such as design. There are many color palette tools to help users search, create, edit, save, and share color themes, but few tools are from the perspective of emotional expression and explicitly address the emotional effects of colors. In this paper, a color hunt system with affective words called ColorEmo is developed. Multiple types of input, including affective words, affective categories in image-scale space, and main colors, are allowed for users with accurate emotional description. Based on the dataset with 428,924 color themes, the system provides rich candidates. The system is designed for user research experiments. The user-friendly interactions are offered for easy color modifications. The affective matching and color harmony are evaluated in real time while changing colors. This system can be used in many scenarios of designs and applications.