Oil palm trees are important economic crops in tropical areas. Accurate knowledge of the number of oil palm trees in a plantation area is important to predict the yield of palm oil, manage the growing situation of the palm trees and maximise their productivity. In this study, we propose a novel automatic method for detection and enumeration of individual oil palm trees using images from unmanned aerial vehicles. This method required three major steps. First, images from unmanned aerial vehicles were classified as vegetation or non-vegetation by the support vector machine classifier. Second, a feature descriptor based on the histogram of oriented gradient was designed for palm trees and used to extract features for machine learning. Finally, a support vector machine classifier was trained and optimised using the histogram of oriented gradient features from positive (i.e., oil palm trees) and negative samples (i.e., objects other than oil palm trees). The trained classifier was then applied to detect individual oil palm trees using adaptive moving windows that allowed it to also return the crown size of each oil palm tree. The method was trained at one site and validated independently at four other sites with different situations. The overall accuracy of palm tree detection was 99.21% at the training site and 99.39%, 99.06%, 99.90% and 94.63% at the four validation sites; the last one was for the most challenging site, in which palm trees were mixed with other trees. These tests confirm the effectiveness of the proposed method. The simplicity and great efficiency of the proposed method allow it to support oil palm tree counting for large areas using imagery from unmanned aerial vehicles.