Heterotopic ossification (HO) after elbow trauma can be responsible for significant motion restrictions. The study’s primary aim was to develop a new X-ray-based classification for HO of the elbow. This retrospective study analyzed elbow injury radiographs from 138 patients aged 6–85 years (mean 45.9 ± 18) who underwent operative treatment. The new classification was applied at 6 weeks, 12 weeks, and 6 months postoperatively. The severity of HO was graded from 0 to 4 and localization was defined as r (radial), p (posterior), u (ulnar) or a (anterior) by two observers. The patients were categorized based on injury location and use of non-steroidal anti-inflammatory drugs (NSAIDs) for HO prophylaxis. The correlations between the generated data sets were analyzed using Chi-square tests (χ2) with a significance level of p < 0.05. The inter- and intraobserver reliability was assessed using Cohen’s Kappa. In 50.7% of the evaluated X-rays, the formation of HO could be detected after 12 weeks, and in 60% after 6 months. The analysis showed a significant correlation between the injury’s location and the HO’s location after 12 weeks (p = 0.003). The use of an NSAID prophylaxis did not show a significant correlation with the severity of HO. The classification showed nearly perfect inter- (κ = 0.951, p < 0.001) and intrareliability (κ = 0.946, p < 0.001) according to the criteria of Landis and Koch. Based on the presented classification, the dimension and localization of HO in the X-ray image can be described in more detail compared to previously established classifications and, thus, can increase the comparability of results across studies.