Mineralized collagen fibrils (MCFs) comprise collagen molecules and hydroxyapatite (HAp) crystals and are considered universal building blocks of bone tissue, across different bone types and species. In this study, we developed a coarse-grained molecular dynamics (CGMD) framework to investigate the role of mineral arrangement on the load-deformation behaviour of MCFs. Despite the common belief that the collagen molecules are responsible for flexibility and HAp minerals are responsible for stiffness, our results showed that the mineral phase was responsible for limiting collagen sliding in the large deformation regime, which helped the collagen molecules themselves undergo high tensile loading, providing a substantial contribution to the ultimate tensile strength of MCFs. This study also highlights different roles for the mineralized and non-mineralized protofibrils within the MCF, with the mineralized groups being primarily responsible for load carrying due to the presence of the mineral phase, while the non-mineralized groups are responsible for crack deflection. These results provide novel insight into the load-deformation behaviour of MCFs and highlight the intricate role that both collagen and mineral components have in dictating higher scale bone biomechanics.