Task-based functional magnetic resonance imaging (tfMRI) is a widely used neuroimaging technique in exploring brain networks and functions associated with cognitive behaviors. Traditionally, the general linear model (GLM) is the most popular method in tfMRI data analysis due to its simpleness and robustness. This model-driven method adopts a canonical hemodynamic response function (HRF) and its various derivatives to construct regressors in the design matrix and estimate changes in the tfMRI data. However, a possible limitation of current model-driven methods is that the HRF is fixed and non-adaptive which may overlook other diverse and concurrent brain networks. In order to overcome these limitations, we proposed a novel hybrid framework, supervised brain network learning based on deep recurrent neural networks (SUDRNN), to reconstruct the diverse and concurrent functional brain networks. Specifically, this hybrid framework first takes advantage of the great capacity of deep recurrent neural networks (DRNN) in modeling sequential data to learn the diverse regressors from real tfMRI data. After that, it utilizes the effective supervised dictionary learning (SDL) method to reconstruct both the task-related functional brain networks and other latent brain networks simultaneously. Extensive experiment results on different tfMRI datasets from Human connectome project (HCP) demonstrated the superiority of the proposed framework. INDEX TERMS Task fMRI, brain networks, recurrent neural network, supervised dictionary learning.