A key goal in neuroscience is to understand brain mechanisms of cognitive functions. An emerging approach is "brain decoding", which consists of inferring a set of experimental conditions performed by a participant, using pattern classification of brain activity. Few works so far have attempted to train a brain decoding model that would generalize across many different cognitive tasks drawn from multiple cognitive domains. To tackle this problem, we proposed a domain-general brain decoder that automatically learns the spatiotemporal dynamics of brain response within a short time window using a deep learning approach. By leveraging our prior knowledge on network organization of human brain cognition, we constructed deep graph convolutional neural networks to annotate cognitive states by first mapping the task-evoked fMRI response onto a brain graph, propagating brain dynamics among interconnected brain regions and functional networks, and generating state-specific representations of recorded brain activity.We evaluated the decoding model on a large population of 1200 participants, under 21 different experimental conditions spanning 6 different cognitive domains, acquired from the Human Connectome Project task-fMRI database. Using a 10s window of fMRI response, the 21 cognitive states were identified with a test accuracy of 89% (chance level 4.8%). Performance remained good when using a 6s window (82%). It was even feasible to decode cognitive states from a single fMRI volume (720ms), with the performance following the shape of the hemodynamic response. Moreover, a saliency map analysis demonstrated that the high decoding performance was driven by the response of biologically meaningful brain regions. Together, we provide an automated tool to annotate human brain activity with fine temporal resolution and fine cognitive granularity. Our model shows potential applications as a reference model for domain adaptation, possibly making contributions in a variety of domains, including neurological and psychiatric disorders.the decoding model was constrained by the shape of the hemodynamic response. The stability of the decoding model was finally evaluated by changing the number of subjects used for model training.mixture of hemodynamic responses evoked by different task events. Early attempts have been made by adding independent regressors with delayed onsets (Nishimoto et al. , 2011) . But the simple linear model only generates a blurred image from the average prediction of each category.One possible solution to this problem is to use a multi-label decoding model based on GCN.Specifically, given a short-series of fMRI signals, the model predicts a set of cognitive states instead of one single task condition. Due to the delay effect of hemodynamic response that reaches plateau around 6s past stimulus, we can modify the label matrix by prolonging each event duration until 8s after the task onset and allow multiple labels assigned to the same time point.An interesting potential application of our work would be transfer lear...