Objective To retrospectively analyze the clinical outcomes of two intramedullary fixation devices, the INTERTAN nail and Gamma3 nail, for treatment of AO/OTA 31-A2 trochanteric fractures in elderly patients. Methods In total, 165 elderly patients underwent treatment for AO/OTA 31-A2 trochanteric fractures in our hospital from June 2017 to June 2018 (INTERTAN group, n = 79; Gamma3 group, n = 86). All patients underwent radiological and clinical investigations and were followed up for an average of 12 months. Age, sex, fracture type, surgical time, intraoperative blood loss, fracture healing time, and complications were compared between the two groups. Results The surgical time was significantly shorter and the intraoperative blood loss volume was significantly lower in the Gamma3 than INTERTAN group (58.2 ± 2.5 vs. 81.7 ± 14.2 minutes and 170 ± 29 vs. 220 ± 16 mL, respectively). However, there were no significant differences in the reduction quality, hospital stay, fracture healing time, Harris hip score, postoperative complications, or 1-year postoperative mortality. Conclusion Both INTERTAN and Gamma3 nails may be effective for surgical treatment of AO/OTA 31-A2 trochanteric fractures in elderly patients. However, the Gamma3 nail was superior to the INTERTAN nail in terms of surgical time and intraoperative blood loss.