In this study, we examined the relationship between social factors and language by focusing on color terms. We investigated patterns of color terms’ use and the diversity of the color terms lexicon (CTL) among males and females belonging to different subcultures—city vs. small town or urban vs. rural—and different university majors—professionally color educated vs. others. Using an unconstrained color-naming task performed on a computer, three hundred and ninety-nine participants were asked to type in descriptions for fifteen color samples. The use of lexical items from Modern Standard Arabic (MSA) in the color descriptions was also investigated. Uni/multivariant analyses of the data were carried out in order to test the association between the patterns of color terms and the social independent variables. Females, participants with professional education in colors, and participants from the city were found to have a larger and more diversified CTL than males, participants with no professional color education, and participants from small towns.