Monte Carlo (MC) simulations of radiation transport may provide more accurate estimates of dose delivered to permanent implant brachytherapy patients compared to the current clinical AAPM TG-43 dose calculation paradigm. However, MC dose calculations are burdened by considerable sensitivity to several required modelling assumptions, especially with the low-energy photon sources typical of permanent implant brachytherapy (20-30 keV). MC simulations require a detailed virtual model of the patient, often derived from post-treatment CT images which contain imaging artifacts due to the presence of the brachytherapy sources during image acquisition. For the first time, several metallic artifact reduction algorithms, of varied approach, are explored in phantom and clinical prostate brachytherapy CT images to determine their ability to mitigate artifacts and to quantify the sensitivity on the resulting dose calculations. Permanent implant breast brachytherapy presents a particular challenge to model due to the radiologically different adipose and fibrogland soft tissues in and near the treatment volume. Further, the geometry of a breast treatment is especially non-water like which suggests the clinical TG-43 dose calculation paradigm may yield significantly inaccurate results. The dose calculation sensitivity to metallic artifact reduction, tissue differentiation approach and simulated tissue composition are explored in permanent implant breast brachytherapy clinical patient data, in addition i