Comparative Analysis of CNNs and Vision Transformers for Automatic Classification of Abandonment in Douro’s Vineyard Parcels

Abstract

The Douro Demarcated Region is fundamental to local cultural and economic identity. Despite its importance, the region faces the challenge of abandoned vineyard plots, caused, among other factors, by the high costs of maintaining vineyards on hilly terrain. To solve this problem, the European Union (EU) offers subsidies to encourage active cultivation, with the aim of protecting the region’s cultural and environmental heritage. However, monitoring actively cultivated vineyards and those that have been abandoned presents considerable logistical challenges. With 43,843 vineyards spread over 250,000 hectares of rugged terrain, control of these plots is limited, which hampers the effectiveness of preservation and incentive initiatives. Currently, the EU only inspects 5 per cent of farmers annually, which results in insufficient coverage to ensure that subsidies are properly used and vineyards are actively maintained. To complement this limited monitoring, organisations such as the Instituto dos Vinhos do Douro e do Porto (IVDP) use aerial and satellite images, which are manually analysed to identify abandoned or active plots. To overcome these limitations, images can be analysed using deep learning methods, which have already shown great potential in agricultural applications. In this context, our research group has carried out some preliminary evaluations for the automatic detection of abandoned vineyards using deep learning models, which, despite showing promising results on the dataset used, proved to be limited when applied to images of the entire region. In this study, a new dataset was expanded to 137,000 images collected between 2018 and 2023, filling critical gaps in the previous datasets by including greater temporal and spatial diversity. Subsequently, a careful evaluation was carried out with various DL models. As a result, the ViT_b32 model demonstrated superior performance, achieving an average accuracy of 0.99 and an F1 score of 0.98, outperforming CNN-based models. In addition to the excellent results obtained, this dataset represents a significant contribution to advancing research in precision viticulture, providing a solid and relevant basis for future studies and driving the development of solutions applied to vineyard monitoring in the Douro Demarcated Region. These advances not only improve efficiency in detecting abandoned plots, but also contribute significantly to optimising the use of subsidies in the region.