The existence of pseudo-gap states at energies larger than the coherence energy scale is shown to be at the origin of the difficulties encountered in achieving strong vortex pinning in the high Tc cuprates. Reduction or elimination of the pseudo-gap states by overdoping is effective in increasing the condensation energy and the irreversibility field. In YBa2Cu3O7, a full BCS state, with a single energy scale, can be restored, leading to the highest known irreversibility field and pinning strength. In the bismuthates, the detrimental effect of the pseudo-gap states can only be mitigated to some extent by overdoping.