ObjectiveThis retrospective study aimed to evaluate the performance of machine learning techniques in predicting air‐bone gap after tympanoplasty compared with conventional scoring models and to identify the influential factors.MethodsWe reviewed the charts of 105 patients (114 ears) with chronic otitis media who underwent tympanoplasty. Two numerical scoring systems (middle ear risk index [MERI] and ossiculoplasty outcome parameter staging [OOPS]) and three algorithms (random forest [RF], support vector machine [SVM], and k nearest neighbor [kNN]) were created. Experimental variables included age, preoperative air‐bone gap, soft‐tissue density lesion in the tympanic cavity in CT, otorrhea, surgical history, ossicular bone problems in CT, tympanic perforation location, perforation type (central or marginal), grafting material, smoking history, endoscopy use, and the operator whose experience was 20 years or longer, or shorter. Binary classification, postoperative air‐bone gap ≤15 or >15 dB, and multiclass classification, classification into seven categories by 10 dB, were performed, and the percentages of correct prediction were calculated. The importance of features in the RF model was calculated to identify influential factors.ResultsThe percentages of correct prediction in binary classification were 62.3%, 72.8%, 81.5%, 81.5%, and 81.5% in MERI, OOPS, RF, SVM, and kNN, respectively, and those in multiclass classification were 29.8%, 21.9%, 63.1%, 44.7%, and 50% in the same order. The RF model suggested larger preoperative air‐bone gap, and older age could make the postoperative air‐bone gap larger.ConclusionThe machine learning techniques, especially the RF model, are promising methods for precise postoperative air‐bone gap prediction.Level of Evidence4 Laryngoscope, 133:2371–2378, 2023