In radiotherapy, a trade-off exists between computational workload/speed and dose calculation accuracy. Calculation methods like pencil-beam convolution can be much faster than Monte-Carlo methods, but less accurate. The dose difference, mostly caused by inhomogeneities and electronic disequilibrium, is highly correlated with the dose distribution and the underlying anatomical tissue density. We hypothesize that a conversion scheme can be established to boost low-accuracy doses to highaccuracy, using intensity information obtained from computed tomography (CT) images. A deep learning-driven framework was developed to test the hypothesis by converting between two commercially available dose calculation methods: Anisotropic analytic algorithm (AAA) and Acuros XB (AXB). A hierarchically dense U-Net model was developed to boost the accuracy of AAA dose toward the AXB level. The network contained multiple layers of varying feature sizes to learn their dose differences, in relationship to CT, both locally and globally. Anisotropic analytic algorithm and AXB doses were calculated in pairs for 120 lung radiotherapy plans covering various treatment techniques, beam energies, tumor locations, and dose levels. For each case, the CT and the AAA dose were used as the input and the AXB dose as the "ground-truth" output, to train and test the model. The mean squared errors (MSEs) and gamma passing rates (2 mm/2% & 1 mm/1%) were calculated between the boosted AAA doses and the "ground-truth" AXB doses. The boosted AAA doses demonstrated substantially improved match to the "ground-truth" AXB doses, with average (± s.d.) gamma passing rate (1 mm/1%) 97.6% (±2.4%) compared to 87.8% (±9.0%) of the original AAA doses. The corresponding average MSE was 0.11(±0.05) vs 0.31(±0.21). Deep learning is able to capture the differences between dose calculation algorithms to boost the low-accuracy algorithms. By combining a less accurate dose calculation algorithm with a trained deep learning model, dose calculation can potentially achieve both high accuracy and efficiency.