Sexism is prevalent in today's society, both offline and online, and poses a credible threat to social equality with respect to gender. According to ambivalent sexism theory (Glick and Fiske, 1996), it comes in two forms: Hostile and Benevolent. While hostile sexism is characterized by an explicitly negative attitude, benevolent sexism is more subtle. Previous works on computationally detecting sexism present online are restricted to identifying the hostile form. Our objective is to investigate the less pronounced form of sexism demonstrated online. We achieved this by creating and analyzing a dataset of tweets that exhibit benevolent sexism. We classified tweets into 'Hostile', 'Benevolent' or 'Others' class depending on the kind of sexism they exhibit, by using Support Vector Machines (SVM), sequenceto-sequence models and FastText classifier. We achieved the best F1-score using FastText classifier. Our work aims to analyze and understand the much prevalent ambivalent sexism in social media.