Bulk niobium is the most common material used in the fabrication of rf superconducting cavities for accelerators. Predicting and reducing the rf surface dissipation in these cavity structures is mandatory, since it has a tremendous cost impact on the large accelerator projects. In this paper the author hopes to demonstrate that sources of dissipation usually attributed to external causes (mainly flux trapping during cooldown and hydrides precipitates) are related to the same type of crystalline defects that affect the local superconducting properties and can be at the source of early vortex penetration at the surface. We also want to show how these types of defects can explain some of the discrepancies observed from other laboratories in niobium cavity doping experiments. Understanding the origin and the role of these defects could provide direction for improving material specifications as well as improving fabrication control from sheet material to completed cavity. In particular, we will demonstrate that dislocation entanglements, due to the fabrication damage layer, have the strongest impact for the pinning behavior of trapped flux, as well as hydrogen segregation in cavity niobium. The author wishes to present to the superconducting radio frequency (SRF) accelerator community the synthesis of experimental results scattered in the literature, completed with some personal results. The results of this effort provide a new perspective on recently published work in the domain of SRF cavity doping and sensitivity to trapped flux during cooldown. I will also try to draw whenever possible, some conclusions about other types of superconductors used for SRF applications including Nb=Cu thin films and to discuss their possible change of behavior with field or frequency. I will concentrate on surface and material science aspects since the experimental results on rf cavities have already been treated elsewhere.