Nitrogen is an essential element required for plant growth and productivity. Understanding the mechanisms and natural genetic variation underlying nitrogen use in plants will facilitate engineering plant nitrogen use to maximize crop productivity while minimizing environmental costs. To understand the scope of natural variation that may influence nitrogen use, we grew 1135 Arabidopsis thaliana natural genotypes on two nitrogen sources, nitrate and ammonium, and measured both developmental and defense metabolite traits. By using different environments and focused on multiple traits, we identified a wide array of different nitrogen responses. These responses are associated with a large number of genes, most of them not previously associated with nitrogen responses. Only a small portion of these genes appear to be shared between environments or traits while most of the detected genes are predominantly specific to a developmental or defense trait under a specific nitrogen source. Finally, by using a large population we were able to identify unique nitrogen responses, like preferring ammonium or nitrate, that appear to be generated by combinations of loci rather than a few large effect loci. This suggests that it may be possible to obtain novel phenotypes in complex nitrogen responses by manipulating sets of genes with small effects rather than solely focusing on large effect single gene manipulations.