We prove that, if the centralizer of a Banach space X is infinite-dimensional, then every nonempty relatively weakly open subset of the closed unit ball of X has diameter equal to 2. This result, together with a suitable refinement also proven in the paper, contains (and improves in some cases) previously known facts for C * -algebras, J B * -triples, spaces of vector valued continuous functions, and spaces of operators.