High ambient temperature has adverse effects on plant vegetative and reproductive development and reduces crop yield. To better understand the importance of male and female fertility for tomato fruit set ability under high temperature conditions and to test whether heat tolerance levels among and between reproductive and vegetative traits of genotypes correlate with each other, 13 tomato cultivars were subjected to long-term moderate heat (LTMH) or short-term heat shock (STHS), depending on the trait that was evaluated. LTMH caused significant decrease in performance of nearly all reproductive traits, i.e. pollen viability, pollen number, female fertility, seeded-fruit set and flower number per inflorescence, but not in inflorescence number. Considerable variation was found among cultivars, both under control and LTMH conditions. The cultivars Nagcarlang, Saladette and Malintka 101 produced a higher percentage of viable pollen under LTMH. For fruit set under LTMH condition, only cultivars that had been previously reported as being heat-tolerant produced fruits with seeds. STHS negatively affected vegetative traits concerning seedling survival and membrane stability. Correlation analysis revealed relationships between various traits within the control and heat treatments, but not between the two. Under heat stress fruit set was positively correlated with pollen viability, as well as with flower number per inflorescence. However, no significant correlations were found between vegetative and reproductive traits. Our data highlight the prominent role of pollen viability for tomato fertility under LTMH growth conditions. The observed variation in thermotolerance among different cultivars offers the possibility to decipher underlying physiological and genetic mechanisms.