Thirty-seven commercial aldehydes containing aliphatic chains and aromatic rings as well as heteroaromatic rings were evaluated for their inhibitory activities against Chinese amaranth (Amaranthus tricolor L.) and barnyardgrass (Echinochloa crus-galli (L.) Beauv). Polysorbate 80 (Tween® 80) was used as a surfactant and the research was preliminarily conducted at 400 μM of all aldehydes. Among these aldehydes, (E)-cinnamaldehyde (7) showed the greatest inhibitory effect on seed germination, shoot and root growth of Chinese amaranth by 54.55%, 75.53%, and 85.13% respectively. Similarly, (E)-crotonaldehyde (5), a related α,β-unsaturated aldehyde, inhibited the germination and seedling growth of the tested species at a high percentage. Apart from these two unsaturated aldehydes, no other aliphatic aldehydes had a harmful effect on Chinese amaranth. In terms of benzaldehyde (6), it had no effect on the tested plant; however, many of its derivatives displayed some inhibitory activity. Furthermore, for the ten common heteroaromatic aldehydes, picolinaldehyde (32) had a high inhibitory effect on Chinese amaranth which closely related to the effect of (E)-crotonaldehyde (5) and (E)-cinnamaldehyde (7), whereas, other heteroaromatic aldehydes showed lower effects. In the case of a monocot plant, barnyardgrass, no tested aldehydes reduced seed germination, however, (E)-cinnamaldehyde (7), 2,4,6-trimethoxybenzaldehyde (16) and 4-(dimethylamino)benzaldehyde (24) could inhibit the seedling growth of the plant with low to moderate levels. The herbicidal effects of the most active aldehydes were then further investigated in order to find the minimum concentration of these aldehydes suppressing the germination and growth of the tested plants. At concentrations as low as 50–100 μM some aldehydes could inhibit the seedling growth of the tested species. The structure-activity relationship (SAR) study reported here demonstrates the chemical clues governing the inhibitory activity of aldehydes which could be utilized in the development of highly effective herbicides in the near future.