Heart disease is one of the most common causes of death globally. In this study, machine learning algorithms and models widely used in the literature to predict heart disease have been extensively compared, and a hybrid feature selection based on genetic algorithm and tabu search methods have been developed. The proposed system consists of three components: (1) preprocess of datasets, (2) feature selection with genetic and tabu search algorithm, and (3) classification module. The models have been tested using different datasets, and detailed comparisons and analysis were presented. The experimental results show that the Random Forest algorithm is more successful than Adaboost, Bagging, Logitboost, and Support Vector machine using Cleveland and Statlog datasets.