Sonodynamic therapy (SDT) is an emerging non-invasive cancer treatment method in the field of nanomedicine, which has the advantages of deep penetration, good therapeutic efficacy, and minimal damage to normal tissues. Sonosensitizers play a crucial role in the process of SDT, as their structure and properties directly determine the treatment outcome. Inorganic sonosensitizers, with their high stability and longer circulation time in the human body, have great potential in SDT. In this review, the possible mechanisms of SDT including the ultrasonic cavitation, reactive oxygen species generation, and activation of immunity are briefly discussed. Then, the latest research progress on inorganic sonosensitizers is systematically summarized. Subsequently, strategies for optimizing treatment efficacy are introduced, including combination therapy and image-guided therapy. The challenges and future prospects of sonodynamic therapy are discussed. It is hoped that this review will provide some guidance for the screening of inorganic sonosensitizers.