Immunoglobulin A nephropathy (IgAN) is the most frequent form of glomerulonephritis, which is characterized by glomerular proliferation and renal inflammation. Icariin is a flavonoid from the Chinese herb Epimedium, and its anti‐inflammatory effect has been reported. This study aimed to investigate the effects of icariin on the renal damage in IgAN rats and the mechanisms behind these effects. IgAN model was established in Sprague–Dawley rats by oral and intravenous immunization with bovine gamma‐globulin for 12 weeks, and rats were treated with icariin from 12 to 18 weeks. At the end of experimental period, kidneys, urine, and blood samples were collected for further analysis. Our results showed that icariin ameliorated the increase in the levels of proteinuria, serum creatinine, and urea nitrogen without severe side effects. IgAN rats exhibited significantly increased IgA deposition, mesangial matrix expansion, and glomerular fibrosis, while icariin treatment markedly attenuated these alterations. Moreover, treatment with icariin also dramatically blocked nuclear factor kappa b (NF‐κB) nuclear translocation and Nlrp3 inflammasome activation in IgAN rats, leading to reduced downstream proinflammatory cytokines production. Mechanistically, we found that icariin treatment inhibited IKKβ and IκBα phosphorylation and IκBα degradation in IgAN rats. Our data demonstrate that icariin ameliorates renal damage in IgAN rats via inhibition of NF‐κB‐mediated Nlrp3 inflammasome activation. These findings provide insight into an application of icariin for the treatment of IgAN disease, and represent a novel mechanism behind these effects.