Flowers are generally short-lived, and they all face a multidimensional challenge because they have to attract mutualists, compel them to vector pollen with minimal investment in rewards, and repel floral enemies during this short time window. Their displays are under complex selection, either consistent or conflicting, to maximize reproductive fitness under heterogeneous environments. The phenological or morphological mismatches between flowers and visitors will influence interspecific competition, resource access, mating success and, ultimately, population and community dynamics. To better understand the effects of the plant visitors on floral traits, it is necessary to determine the functional significance of specific floral traits for the visitors; how plants respond to both mutualists and antagonists through adaptive changes; and to evaluate the net fitness effects of biological mutualisms and antagonism on plants. In this review, we bring together insights from fields as diverse as floral biology, insect behavioral responses, and evolutionary biology to explain the processes and patterns of floral diversity evolution. Then, we discuss the ecological significance of plant responses to mutualists and antagonists from a community perspective, and propose a set of research questions that can guide the research field to integrate studies of plant defense and reproduction.