Figure 1: Our method takes as input an image and two captions from different sources, and we predict whether the image has been used out of context. Here, both captions align with same object(s) in the image; i.e., Donald Trump and Angela Merkel on the left and President Obama and Dr. Fauci on the right. If the two captions are semantically different from each other (right), we consider them as out of context; otherwise not (left). Our method automatically detects such image use.

No abstract

No abstract

No abstract

No abstract