EndTimes at SemEval-2021 Task 7: Detecting and Rating Humor and Offense with BERT and Ensembles

Abstract

This paper describes Humor-BERT, a set of BERT (Devlin et al., 2019) Large based models that we used to solve the SemEval-2021 Task 7: Detecting and Rating Humor and Offense (Meaney et al., 2021). It presents pre and post processing techniques, variable threshold learning, meta learning and Ensemble approach to solve various sub-tasks that were part of the challenge. We also present a comparative analysis of various models we tried. Our method was ranked 4 th in Humor Controversy Detection, 8 th in Humor Detection, 19 th in Average Offense Score prediction and 40 th in Average Humor Score prediction globally. F1 score obtained for Humor classification was 0.9655 and for Controversy detection it was 0.6261. Our user name on the leader board is ThisIstheEnd and team name is End-Times.