Deep learning techniques such as convolutional neural networks (cnns) can potentially provide powerful tools for classifying, identifying, and predicting patterns in climate and environmental data. However, because of the inherent complexities of such data, which are often spatio-temporal, chaotic, and non-stationary, the CNN algorithms must be designed/evaluated for each specific dataset and application. Yet cnn, being a supervised technique, requires a large labeled dataset to start. Labeling demands (human) expert time which, combined with the limited number of relevant examples in this area, can discourage using CNNs for new problems. To address these challenges, here we (1) Propose an effective auto-labeling strategy based on using an unsupervised clustering algorithm and evaluating the performance of CNNs in re-identifying and predicting these clusters up to 5 days ahead of time;(2) Use this approach to label thousands of daily large-scale weather patterns over North America in the outputs of a fully-coupled climate model and show the capabilities of cnns in re-identifying and predicting the 4 clustered regimes up to 5 days ahead of time. The deep CNN trained with 1000 samples or more per cluster has an accuracy of 90% or better for both identification and prediction while prediction accuracy scales weakly with the number of lead days. Accuracy scales monotonically but nonlinearly with the size of the training set, e.g. reaching 94% with 3000 training samples per cluster for identification and 93-76% for prediction at lead day 1-5, outperforming logistic regression, a simpler machine learning algorithm, by ~ 25%. Effects of architecture and hyperparameters on the performance of cnns are examined and discussed. open Scientific RepoRtS | (2020) 10:1317 | https://doi.org/10.1038/s41598-020-57897-9www.nature.com/scientificreports www.nature.com/scientificreports/ transformed pattern recognition and image processing in various domains of business and science 44,45 and can potentially become a powerful tool for classifying and identifying patterns in climate and environmental data 43 . In fact, in their pioneering work, Liu et al. 46 and Racah et al. 47 have shown the promising capabilities of CNNs in identifying tropical cyclones, weather fronts, and atmospheric rivers in large, labeled climate datasets.Despite the success in applying CNNs in these few studies, there are some challenges that should be addressed to further expand the applications and usefulness of CNNs (and similar deep learning techniques) in climate and environmental sciences 48 . One major challenge is that unlike the data traditionally used to develop and assess CNN algorithms such as the static images in ImageNet 49 , climate and environmental data, from model simulations or observations are often spatio-temporal, highly nonlinear, chaotic, high-dimensional, non-stationary, multi-scale, and correlated. For example, the large-scale atmospheric circulation, whose variability strongly affects day-to-day weather and extreme events, is a high-dim...