Impaired bone-fracture healing is associated with long-term musculoskeletal disability, pain and psychological distress. Low-intensity pulsed ultrasound (LIPUS) is a non-invasive and side-effect-free treatment option for fresh, delayed- and non-union bone fractures, which has been used in patients since the early 1990s. Several clinical studies, however, have questioned the usefulness of the LIPUS treatment for the regeneration of long bones, including those with a compromised healing. This systematic review addresses the hurdles that the clinical application of LIPUS encounters. Low patient compliance might disguise the effects of the LIPUS therapy, as observed in several studies. Furthermore, large discrepancies in results, showing profound LIPUS effects in regeneration of small-animal bones in comparison to the clinical studies, could be caused by the suboptimal parameters of the clinical set-up. This raises the question of whether the so-called “acoustic dose” requires a thorough characterisation to reveal the mechanisms of the therapy. The adequate definition of the acoustic dose is especially important in the elderly population and patients with underlying medical conditions, where distinct biological signatures lead to a delayed regeneration. Non-industry-funded, randomised, double-blind, placebo-controlled clinical trials of the LIPUS application alone and as an adjuvant treatment for bones with complicated healing, where consistent control of patient compliance is ensured, are required.