Jinhua ham is a traditional cured meat food in China. For a long time, its grade has mainly been evaluated by the human nose through the three-sticks method, which is highly subjective and is not conducive to establishing evaluation standards through odor markers. In this paper, we analyzed the well-graded Grade I–III hams provided by Jinzi Ham Co., Ltd. (Jinhua, China). Firstly, we used different extraction fibers, extraction temperatures, and extraction time to determine the optimal conditions for headspace solid-phase microextraction (HS-SPME). Then, the aroma components of Jinhua ham were analyzed by headspace solid-phase microextraction combined with gas chromatography–mass spectrometry (GC–MS), and OAV was calculated to screen the key aroma volatiles of three kinds of Jinhua ham. It was found that a total of 56 components were detected in the three types of ham. Among them, there are 21 kinds of key aroma volatiles. Aldehydes, alcohols, and acids are the three main components of Jinhua ham, and the content of aldehydes gradually decreases from Grade I to Grade III ham. The content of acids gradually increased, and we speculated that the increase in acid content was caused by the proliferation of microorganisms in Grade III ham. The key flavor volatiles in Grade I hams was hexanal and 2-methylbutanal. Grade I hams had a strong meat aroma, pleasant fatty, and roasted aroma without any off-flavors. In Grade II ham, the characteristic volatiles (E,E)-2,4-decadienal and ethyl isovalerate were detected. These two volatiles contribute greatly to the flavor of Grade II ham, which makes the flavor of Grade II ham have a special fruity aroma. They also may be prone to sourness and affect the flavor of the ham. Volatiles with low threshold values, such as pyrazines, furans, and sulfur-containing compounds, were relatively high in Grade III hams. This may also contribute to the poorer flavor quality of Grade III hams. This experiment provided a reliable test method and evaluation basis for the rating of Jinhua ham. These results have positive implications for the establishment of odor markers-based grading criteria.