Abiotic stressors such as extreme temperatures, drought, flood, light, salt, and heavy metals alter biological diversity and crop production worldwide. Therefore, it is important to know the mechanisms by which plants cope with stress conditions. Polyphenols, which are the largest group of plant-specialized metabolites, are generally recognized as molecules involved in stress protection in plants. This diverse group of metabolites contains various structures, from simple forms consisting of one aromatic ring to more complex ones consisting of large number of polymerized molecules. Consequently, all these molecules, depending on their structure, may show different roles in plant growth, development, and stress protection. In the present review, we aimed to summarize data on how different polyphenol structures influence their biological activity and their roles in abiotic stress responses. We focused our review on phenolic acids, flavonoids, stilbenoids, and lignans.