Recently, Deep Learning and blockchain technology has gained successful attention in recent research due to their high potential for generating accurate decision. The operational transparency, traceability, dependability, security, and trustworthy data provenance characteristics are offered by the vast majority of current deep learning approaches that are developed on centralized servers. Therefore, using centralized data to train Deep Learning models makes them vulnerable to the single point of failure issue. In this article, the benefits of combining Blockchain and Deep Learning algorithms are explored. Moreover, the state-of-the-art literature is reviewed to find out the most possible way to integrate these two technologies for an optimal solution. Based on the literature survey this article is divided by a thematic taxonomy that includes seven different parameters such as Deep Learning techniques, protocols, domains, types of blockchain, use of deep learning and blockchain, and datasets. We have outlined the advantages and disadvantages of the most advanced blockchain-based deep learning frameworks to give insightful discussions. At last, the most important challenges that need further research are also highlighted with future recommendations.