Background: Temporal lobe epilepsy is a common neurological disease that affects many areas of patients’ lives, including social competence. The aim of the study was to assess theory of mind in patients with temporal lobe epilepsy and to investigate the demographic and clinical factors associated with this function. Methods: A total of 65 participants took part in the study, which included 44 patients with epilepsy and 21 demographically matched healthy individuals. The following neuropsychological tests were used to examine theory of mind: the Faux Pas Test, the Hinting Task, the Emotion Comprehension Test, and a cognitive function screen, the Montreal Cognitive Assessment. Results: Patients with epilepsy scored lower on all measures of the theory-of-mind tests. Moreover, in the clinical group, numerous moderate and strong correlations were found between the theory-of-mind tests and education, age at onset of epilepsy, lateralization of epileptic focus, cognitive status, and, to a lesser degree, number of anti-epileptic drugs, frequency of seizures, and age. In contrast, in the control group, significant correlations were found mostly between the theory-of-mind tests and sex, and, to a lesser degree, age. Education and cognitive functioning were not associated. Conclusions: Patients with epilepsy experience difficulties in theory of mind, which may have a negative impact on the quality of their social relationships. The level of theory-of-mind abilities correlates with particular clinical and demographic indicators. Recognizing these issues allows clinicians to implement tailored interventions, potentially improving patients’ quality of life.