Prostate cancer has high heritability. Healthy lifestyle has been associated with lower lethal prostate cancer risk among men at increased genetic susceptibility, but the role of healthy dietary patterns remains unknown. We prospectively followed 10,269 genotyped men in the Health Professionals Follow‐up Study (1993–2019). Genetic risk was quantified using an established polygenic risk score (PRS). Five dietary patterns were investigated: healthy eating index, Mediterranean, diabetes risk‐reducing, hyperinsulinemic and inflammatory diet. Overall and lethal prostate cancer rates (metastatic disease/prostate cancer‐specific death) were analyzed using multivariable Cox proportional hazards models. During 26 years of follow‐up, 2133 overall and 253 lethal prostate cancer events were documented. In the highest PRS quartile, higher adherence to a diabetes risk‐reducing diet was associated with lower rates of overall (top vs. bottom quintile HR [95% CI], 0.74 [0.58–0.94]) and lethal prostate cancer (0.43 [0.21–0.88]). A low insulinemic diet was associated with similar lower rates (overall, 0.76 [0.60–0.95]; lethal, 0.46 [0.23–0.94]). Other dietary patterns showed weaker, but similar associations. In the highest PRS quartile, men with healthy lifestyles based on body weight, physical activity, and low insulinemic diet had a substantially lower rate (0.26 [0.13–0.49]) of lethal prostate cancer compared with men with unhealthy lifestyles, translating to a lifetime risk of 3.4% (95% CI, 2.3%–5.0%) among those with healthy lifestyles and 9.5% (5.3%–16.7%) among those with unhealthy lifestyles. Our findings indicate that lifestyle modifications lowering insulin resistance and chronic hyperinsulinemia could be relevant in preventing aggressive prostate cancer among men genetically predisposed to prostate cancer.