Peridynamic (PD) theories have become widespread in various research areas due to the ability of modeling discontinuity formation and evolution in materials. Bond-based peridynamics (BB-PD), notwithstanding some modeling limitations, is widely employed in numerical simulations due to its easy implementation combined with physical intuitiveness and stability. In this paper, we review and investigate several aspects of bond-based peridynamic models. We present a detailed description of peridynamics theory, applications, and numerical models. We display the employed BB-PD integral kernels together with their differences and commonalities; then we discuss some consequences of their mathematical structure. We critically analyze and comment on the kinematic role of nonlocality, the relation between kernel structure and material impenetrability, and the role of PD kernel nonlinearity in crack formation prediction. Finally, we propose and present the idea of extending BB-PD to fluids in the framework of fading memory material, drawing some perspectives for a deeper and more comprehensive understanding of the peridynamics in fluids.