Nitrogen fertilization level and harvesting season significantly impact tea aroma quality. In this study, we analyzed the volatile organic compounds of fresh Jin Xuan (JX) tea leaves under different nitrogen application levels (N0, N150, N300, N450) during summer and autumn. A total of 49 volatile components were identified by gas chromatography–mass spectrometry (GC-MS). Notably, (E)-2-hexenal, linalool, and geraniol were the main contributors to the aroma of fresh JX leaves. The no-nitrogen treatment (N0) presented the greatest quantity and variety of volatiles in both seasons. A greater difference in volatile compounds was observed between nitrogen treatments in summer vs. autumn. The N0 treatment had a greater total volatile concentration in summer, while the opposite was observed in the nitrogen application treatments (N150, N300, N450). Summer treatments appeared best suited to black tea production. The concentration of herbaceous aroma-type volatiles was higher in summer, while the concentration of floral volatiles was higher in autumn. Volatile concentrations were highest in the N0 and N450 treatments in autumn and appeared suitable for making black tea and oolong tea. Overall, this research provides valuable insights into how variations in N application rates across different harvesting seasons impact the aroma characteristics of tea leaves.