Because bone marrow-derived stromal cells (BMSCs) are able to generate many cell types, they are envisioned as source of regenerative cells to repair numerous tissues, including bone, cartilage, and ligaments. Success of BMSC-based therapies, however, relies on a number of methodological improvements, among which better understanding and control of the BMSC differentiation pathways. Since many years, the biochemical environment is known to govern BMSC differentiation, but more recent evidences show that the biomechanical environment is also directing cell functions. Using in vitro systems that aim to reproduce selected components of the in vivo mechanical environment, it was demonstrated that mechanical loadings can affect BMSC proliferation and improve the osteogenic, chondrogenic, or myogenic phenotype of BMSCs. These effects, however, seem to be modulated by parameters other than mechanics, such as substrate nature or soluble biochemical environment. This paper reviews and discusses recent experimental data showing that despite some knowledge limitation, mechanical stimulation already constitutes an additional and efficient tool to drive BMSC differentiation.