Plants are the source of numerous remedies in modern medicine, and some of them have been studied due to their potential immunomodulatory activity. Astragalus membranaceus Fisch. ex Bunge (A. membranaceus), Nigella sativa L. (N. sativa), and Perilla frutescens (L.) Britton (P. frutescens) are plant species used in traditional medicine for the treatment of various diseases. Their potential to act as immunomodulatory, anti-inflammatory, and anti-allergic agents makes them interesting for investigating their clinical potential in alleviating the symptoms of allergic diseases. Allergy affects a large number of people; according to some sources more than 30% of the world population suffer from some type of allergic reaction, with pollen allergy as the most common type. Treatment is usually pharmacological and may not be completely effective or have side effects. Thus, we are seeking traditional medicine, mostly medicinal plants, with promising potential for alleviating allergy symptoms. A literature overview was conducted employing databases such as Scopus, PubMed, Web of Science, Springer, and Google Scholar. This manuscript summarizes recent in vivo preclinical and clinical studies on three species with immunomodulatory activity, provides a comparison of their anti-allergic effects, and underlines the potential of their application in clinical practice. The obtained results confirmed their efficacy in the in vivo and clinical studies, but also emphasize the problem of phytochemical characterization of the species and difference between tested doses. More clinical trials with standardized protocols (defined active molecules, dosage, side effects) are required to obtain safe and effective herbal drugs.